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J. INTRODUCTION TO THE INTERIM EVALUATION REPORT 

• This Interim EvaluaJ:ion Report has been prepai;e^ liy the Stabilization/ 
, Evaluation ^taff of iihe Experience^ Based Career Education (EBCE) Program 
of the Appalachia Educational^aboratory , IncI (AEL) , The document is 
intended to satisfy a requirement of the AEL/EBCE contract with the 

National Institute of Education (NIE) that an interim internal summativ^ 

^> 

evaluation report be prepared and submitted to the Career Education Program 
^ ^ (CEP) staff of NIE. This, import is resjjonsive in content and form (with 
^ minor modifications) te' the - Guidelines for the interim Evaluation Reports 

'^o^ Experienced-Based- Career Education prepared by the NIE/Model JI 

J — ^ 

e valuator. . , 



The report has not been written fox the general reader. The AEL/EBCE 
'^'^dgram components are described in rather abstract system terms within 
-the report (see especially Section 3). But a' full ^nd detailed description 
of the EBCE Program effort in Kanawha County, West .Virginia ha^ not been 
.attempted. ^ 

.The report is* principally intended fcJr the NIE Career Education Progr^ 
staff and- Members of, the External Site Review Teaun% * It is most meaningfully^ 



read in conjunction with specific program materials cuid such descriptions 
of the program, its staff, and the community^lihdlLts experience sites, as 
^ may be found in the Operational Plari , FY 1974 ; the first Quarterly Progress 

Report; and the second Quarterly Progress Report (December 1, 1973-' 
February 28, 1974). 

In the ev6nt that the reader does not have access to these .more detailed 
program descriptionSf other background materials, or first-hand knowledge 



ERIC / ' i ^ 8 



df Model II programs of NIE/CEP, he is urged to obtain suoh information. 
Program Quarterly Reports may be obtained^ from the EBCE Pr(|>gram Directed:, 
•Appalachia Educational Laboratory, P, 0, "^Box 1348, Charleston, West ViMinia, 

... f z ^. 

25325, ^ ^ 



II. ORGANIZATION OF .THE INTERIM REPORT 



The^report is organised into four sections- 



Section 1 provides an overview of EBCE evaluation activities between 
Septerivber 1> 1973 and March 1, 1974. The first part of the section 
identifies the development of strong formative evaluation as a basic 
resource to, support decision making and program assessment. 

Section 2 presents the activities and:findings of summative evaluation. 

■ ■ . ■■ <r 

" Part vil of Section 2 presents the status of evidence^ concerning each 

/ ■ ' 

evaluation hyppthesis.- ' . / 

Secticin 3 gives an overview of the AEL/EBCE s\absystems and presents 
findings recommendations , and relevant program actions. 

' Section 4 briefly summarizes findings and bonclusipns and x^resents 

/ , . . 

recommendations and relevant progreun actions , recognizing that the formative 

m 

evaluation process is interactive and reiterative. 



SECTION 1 



, Overview of 



Experience Base^Career Education 
Evaltiation Activities 



March 1, 1974 
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I. INTRODUCTION.' 



The purpose of this section of th6 interim report is to highlight 

evaluation activities, suggest a context for their interpretation, and 

( 

to present an analysis of the needs and rationale leading to emphasis 
on stabil^ization and formative evaluation. 

II. M&rOR EMPHASES, IN . EVAtiUAT ION 

The AEL/EBCE conceives the formative evaluation process to be a 

ba^ic resourpe to support decision •making and program assessment. The 

(development of a forma.tive evaluation plan and the instrumentation and 

stie^f to implement th^ plan have been major ^program activities during 
% J. 
*rtl;e current fiscal year. The context in which this evaluation emphasl!s 

; ' ' • • / , _ . ^ 

occurs is the program mandate to achieve a stabilized program prototype * 
by August of 1974 j 'The,, Analysis o% needs and development of ,the 
rationale leading to/the stabilization emphasis afe found in the 
Operational Plan / TY 1974 , Volume II , -pomponent J, "Planning and 
Formative Evaluation." 

In the spring of 1973 program personnel recognized thatxthrou^hout 

^ ' '■ * ' ^ ' ^ \ T 

the previous year planning processes and ^ procedures had been character- 
ized by »dif fused responsibilities knd relative informality, /in many 
C/ases responsibilities for identifying problems, defining information 
needs, collecting and analyzing data, assessing alternatives, and 
jrecommending courses of action were so widely dispersed among the 
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staff that coordination and tracking of decisions was next to impossible* 
Valuable information v^ometimes "-fell through the -cracks" and was' lost. 
' Operational and design activities whre often momentarily stalemated • 
It was fully recogrylzed aarly that planning for stabilization of th^ 
program could not be effective when the staff was so frequently engaged 
in short range, after-the-fact, red flag "problem solving." 

Thus, a need exi/sted for a clearer planning and decision making ^ 
process. It was determined that the need would, be satisfied, in part, 
by the adoption of procedures and assignments which would (1) coordinate 
and consolidate such decision-making activities as planning^ evaluation,, 
infqrmation storage and retreival, and documentation; (2) insure* tha.t 
-decisions are systjrnatically made in light 'of all available informatiory 
and a caref uj^assessmenfc of alternatives; <3) be sufficiently flexible^ 
to work, erficiently with issues and problems of alJ^^sizea and levels 
.of importance* 

A number of alternative^ for reorganization/and staffing were 
considered. It ^as paramount "that a strong and vigorous formative 
evaluation effort ;bo enjoined* Though many persons on the staff were 
trained and experienced in basic research and evaluation techniques, 
there wa^ the need to allocate responsibilities directly to a 'few staff 
jnembers-^to plan and carry out formative evaluation as part of the total ^' 
program proble;n~solving and decision-making prdcesses'being established. 
Yet, at the same time, it was deemed of utmost importance that- the 
evaluation skills of non-evaluators be identified and used* Some 



' individuals ares particularly ^adept at looking for possibilities in all 
sort^ of situations, thereby becoming prime, "hypothesis g^^ators." 
^ Others may be par ticul^^y> skillful in weighing large a^unts of 
complex and subtly conflicting evidence. Stillt others approach issues 
and problems from' the perspective of the persons involved*,, giving . ' 
atte'ntion, thus, to their feelings and, emotions an such a^ay as to 
lead toward humanizing an otherwise Vcold, pbjective^ and purely 
logical" evaluation .procfejss. ' thus, the desire of the p^^am dfreqtor. 
and others was, to/ conc^ptyalize an organizational pattern which would 
capture 'tfie rich and varied input?, ' even at artisitc, ^emotive', and ^ ■ 
intuitive levels, from all staff for syst^atic, information based, , * 
deo4^ion-making* f or the iJrogram., . ^'^ ' . 

. ^ • ■ - ■ \' ' 

^Several efforts*' have been made to develop and impl^meftt* ay system i 
to maximize ''the information base 'on which decisions are m^de. One 
such plan is used extensively within the peyelopment and Design ^Untt 
of the-EBCE Prp^gram. It is a jimple format in which 'ne^ir^y all' . ' . 
problems "can be identified and dealt with kriown as N-R-P, an^ dbbrevia- ' 
tion fbr Need, Rationale, Procedures. The staff uses this NRP approach; 
as a. systematic way to address all sorts and varieties of issues and 
problems. It has not been adopted ^s a problem solving stance in 
other Mnits pf the EBCE program. ^ " * • ^\ 

A second, and more extensive plan for involving alj. staff persons' ^ 

in problem identification and problem solvi,ng has been fd^inally . f 

• ' \ ' 

adopted, though- not yet fully ^implemented. It is the operational 



activity that identifies problems through a Problems/Nieedi Request Form" 
available to all staff metnbers. It also establishes a method by which . 
Problem/Needs are reviewed, prioritized, -and. ^cted upon. 

The Stabi:li2ati9n Unit* which includes the formative evaluator 
and the summative evaluator, reviews each Problems /Needs Request, ;n 
this review, it may be found that the matter can be handled by an 
administrative decision or perhaps by"^ some information available to the 
evaluators. The Problems/Needs Request may suggest an item to be 
analyzed or a whole are^ in which research could or should be done! 

The Stabilisation Management Team, comprised of ' the project director 
.and directors of the Design, Operations, Stabilization and Replication 
Units meet to review all Prob^JLem/Needs Requests. « A full and detailed 
description of the procesfe is shown as Appendix C of this re'port. TJhe 
principle item of Appendix G is the Problem-Solving Procedures state- 
ment, though the memos introducing it art ^nclu<jled for clarification. 

It should be noted thaf formative evaluation inteiracts with this ' 

^ • 

problem solving process jn at lea&t two ways: 

1. It is a major information base. for feeding problems 
irito the fyrocess. * » 

2. "Kie formative ^evaJLuator is' a* primary source to which 



problems are referred to obtain available i-nformation . 
or to generate and conduct mini-experiments or studies 
to, ^nsw^r questions, y 

III. .FORMATIVE EVALUATION ACTIVITIES 



' f 



_ Between September 1 and October 31, the major formative evaluation ^' 
efforts were in planning,* Instrument development accounted for much 




* 



\« Revi^ing^^tha ^^ifeative EyeLiucitiior^ 'Plati- ^ 

^ ♦ ' *'. \ r' ^ , ' ' . v' \ . - * * • 

^ , . • ^ • ' . . ' - 'V / ■ ' • ' ^ . ^ 

Revi^.iritg '^the . Normative ^valuatSdn Plan was W.maa<^r activity ifn ' 

•s'epteinber* and October. Three cchsultajits were s^lectVd. ta-criticrue ' 

the eVa^^uatipo plans and ^o^ propose how th^y c6ulcf-be.;,s^trVn5.then^^/in- 

'?:evisVcin.v 'Dr. James Ward^^^from the University of lilii)jpis ;y4^V ' - ' * ' 

se'iected from among the three to, assist AEL with* th6 r^ylsidni ' rThe. ^ . -^/"-^'i'r \ 

plan revision task was completed October 31, 197j3. An estimated 3(>' \^ 

AEL man-days plus 20 consultant i2ays were used to develop the^revised - 

* - • 

Formative Evaluation Plan. 



» . B. Deverloping Instruments .* ^ 

Instrument development was a major activity from November 1 to 
* Deceni^er^l. .Each instrument was developed on the iDasis of questions 
'outlined in the Fonftative Evaluation Plar^^ , 'the priority analysis and 
^ li^he type -of instrument projected. Instrument development was a seven- 

/ -step, .process. ^ ^ / 

' ' 

// . ,1. The f^rst step was a combined effort between the formative 

- ' . ■ ' ' 

evaluation of AEL/EBCE and the formati\fer 4val\iati6nl -cdn- 



I sultant. * , , '^^A'' 



' / • 2. Th^ sjecond step was a review of fejcis'ting foxmative evaludtiion ^ 

' instruments with the AEL/EBCE Program and. othfef -EBCE prograiA^^ 4^ 



» \ 3. The third step was an analysis of each queStton started in 

' - ^ ^-^ thd^'-plan by the appr'opriate respondent (s ) . / '^-<y 

ERIC ; . , ; , ' 



develop 'the first draft of each 



'findings • V, ' r / 



' -'^ ^'^'^ TbV'fiflth Step^was to adminiip^er ^dhe instruments to- th^ 

- , » .jr#^ '/ %/ ,v • f ' ' ' - ' 

' ' /'v<'r/ ; ' . ^ ^ ' V- r ' //// . , 

// . /•'• •.'. . ; ^PP^opriat^ sample,, analyze the data,/^nd report -findin 

\^ - ' r ' . , ^* * "^^^ si.)^h. step 'is a .revision of. e^cl/ /instrument/based on / . \ / ' ^ 

, //; . * .-"^--^ ^ , • ' '\r: , ' //•' '': 

' ' ^ .the, critiques of the \ first administ^tibn, ' < /' / 'r 

- V : > ' ' ^ ' ^ ' ' ■ / - ' / ' 

^ 7. ;.yhe 9-eventl\ step includes performing ail 'reliability ^p'd ' 

validity -Studies that are , necessary • < ' ; 

It:ems 1 through.' 4 above we^re/ completed during the month of November. / /* 
Item 5 occurred durin<5[;^B%5em^er and J^nuai;y> Itjarms/fi 'and^'T aire pro"-- ^ / 



jected to be conpTeie^' 'and^ r^ported^in the final evaluation^ report, < " * . /* 

A'. , . ' ' - ■ - 1 ^ 

Copies of the,fbrin.5tiyp/in5trum^ appear in this report as Appendix- B. '^-'^ '^ V 



€• Establishing- Timislines \ ' . 

Timelines established for th^ formative evaluation of the Exp^rifence- 
Based Career Education system cover the period of .time ;tetween December - 
1 and January 21-. ^ ;;S'i'nce the plan was revised (September 'through October)' 
and instruments \had- to be developed (November) , , implementing th^ eValua- 
tion soph^r/wpuld' haye been unwise. Du^^ to the late start, each instru- 

r . ' 7 

ment vas administered .once to the^ appropriate sample except where indi- 
cated" in Sect^.on^. c . - ' * . 



1 ^ ' SUMMATIVE EVALUATION ACTIVITIES . 



A,,,-'- Collecting : 4nd Analyzing Preiiminary. Data 

, , During tne Student p^iehtation period on September ^5, each recrtlited 
and selected- EBQE''9>tudept parti-'cipated in a rdata collection program^ 



- einijloying standardized instruments. Eight ho^ts of inventories and 
tests were employed, Tp .a^sess\ student -acadenuc achievementUn reading 

' lan;^age arts, -rththema'ti-cs, social* studies .('science, -^nd /u^e of sources^ 
' the lovj; Tes.t^f EducatiCnai Develppment was -.i^sed. The Career Maturity 
pventfpry wa^sed tb collect Unformitiort about each studentVcar'^er" " 
d^Arelopm^nt. \ ■■ • ■ . •■- / . - 

'^. ' ■ ' ' ' ■ " ■■ / / 



B;. EstabligHing 'Necessary Evaluation- Controls 

The operating task statements ^and the Summative Evaluation Plan 
q?lled for -the rancTom selection of an equal number of students from 
among the volunteers to 'the program to serve as experimental and con- 
trol groups. There was an insufficient^ number bf student volunteers ' 
^fn the fan and at mid-year to permit randomly selecting a control^ 



group . ^ 



7. At- the. fall recruitment, a contingency plan was developed,^ apd ' 

approved by NIE, to identify two comparison groups;, o/e /a completely' 

rando>,^^^mple-q^: seniors from all the Kanawha County Schools, and a ' 

second random samjile group from some. "career education like" programs 

in- the.Kahawha County '.Schools . .Details' of this sampling and testing ' . 

proems appe,ar*';in"Sectidrv/2 of this report. 

-<V ' ' / " ■ * 

_ Therprodedut^s for recruiting students in' such a way as -to meet the 

NIE/CEP_d^mand^ fc^r:,specif).i:,*jumbers remains a problem. It is especially 
"difficult ti?, achieve- an ethWk Wition with respect to, the use of . 
human subjects, in research and development under circuiftitances in which 

funding is contingent upon the Successful completion of the recruitment. 



C. Planning for Data Analysis 
'■ h data analysis plan was requested by NIE as an addenaum to the 

Sununative Evaluanon Plan. Dr. James Weber, a consultant approved by- " 
NIE, developed the plan. This plan was completed in October and approved 
in early November. The plan ^includes a complex multivariate analysis 
scheme, and is presented in part^-in Section 2. 

D. I Instrument Development 

pis activity is detailed in Section 2 and the instruments are 

\ 

X 

displayed in Appendix A. " 



h 

£• A^ministratiQii^ of Instruments 



kDUring January and February, summative activities were at a peak, 
battery of standardized instruments was administered 




students. " 

2| \Quesrtionnaires weire distributed to parents, current students 



1 ' 



^ and participating EBCE 'emplo]J?^rs • 

3* I second mail^ing of questionnaires to 1973 EBCE graduates 

> / ' .* ' 

' , ;:w4s undertaken. - ♦ 



Data^^Analysis .and Reporting 

Most ^^ecent, activities have involved the coitpletion of planned 
data*d"naiyse^7't;est scoring for sefcond semester students, and report 
writ-ing. ' * • i 
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I . INTRODUCTION 

A pi^incipal ' function of summative evaluation is to develop valid^cj 
* * '.f * 

and reliable "evidence of the effects on students of the EBCE Program .} 

y 

and its various components. Jt seeks to answer the question, "What { 

effects on students can be uncimbiguously attributed to the program 

or specific program elements?'! r -\ 

Summative evaluation also seeks to provide evidence on the effec- 
tiveness of th^ program in achieving its s'tated goals as they relate 
to student behavior , program development, and progrcun structure. * 
Summative eval^uation should be -based on instruments with sufficient 
seri^itivity , used icx^designs with sufjEicient experimental rigor, to 
provide information useful ^or program .decision-making as well as for 

NIE/CEP program and funding decisions. . ^ > 

' ' . ' ' 

Instrioments for measuring criterion variables relevant to career 

education are not highly satisfactory at the current time. An effort 
to assess the strength of one instrument (Career Maturity Inventory) 
is reported in the Formative Evaluation section of this -r-eport (Section 
ril) ... 

Changes from the planned experimental design to a quasi-oxj^erimental 
design with non-equal comparison groups are described in this section 
of the report. Most of the data reported in this section relating to * 
current EBCE studen-ts is descriptive. The eff-ects of the pr<||r^ 
based on the comparison of differences in pre-; and post-test scores 
among comparison groups will not be ascertained .until mid-summer of 1974. 
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II • ORGANIZATION 

This se9tion of the report is organised to provide a clear xinder- 
standing of AEL/EBCE's summative evaluation.^ Part III describes the 
design for suimnative evaluation, the data analyses which have been 
done and are planned, and a presentation of the hypotheses to be 
t^ested. Part ,IV presents both the standardized and the specially 
constructed instruments used in. summative evaluation, and also the 
testing timelines. A description of the student populations is 
included as part V of this section. Finally, in part VI, the findings 
of summative evaluation to date are presented with explanations of 
questionnaire administration and results. 

III. DESIGN OF SUMMATIVE EVALUATION- ' . 

' .The primary purpose of the summative evaluation design is to 
provide valid and reliable evidence on the effectiveness of the pro- 
ducts and the resources required of the AEL/EBCE Program. This desiqn 
is ^particularly aimed at the evaluation need^ for program dissemination 
although the restilts will be of for^^ive use to 'staff as they -COmple'te 
program development. . ^ ^4 

a: Description of the Design ' ^ ' \ 

The summativ'e evaluation design is illustrated in Figure 2-1.' I's 

represent 'input or classification variables; X's represent criterion 

vari^les. One group bf the two EBCE Program starts included students 
^* ' * » 

ejirolled in the EBCE Program in September of 1973 in^kf) ; these students 

12 • • 
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Figure 2-1 ' 
Suimnative Evaluation Design 

(1) Pre-Post» Comparison Group Design: 
. September-October, 1973 

I/X , ' (EBCE Program) 

I/X (COOP Sample) . 

I/X (Random Sample of Seniors] 

(2) One-Group Pre-Post Design: 
September, 1973 January, 1974 

i lEBCE Program Students) 

IfX (Midyear EBCE Students) 



3) Onp-Group Post^Te^st Only Design: 



September, 1973.^. 
(EBCE J^r'oqram) 



January^ 1974 
(EBCE Midyear Program Start^s)' ^ 



May, 1974 
X 
X 

f X 

* 

May, 1^74 
.X 
X 



May, 1974 
X^ 



13 



^^are scheduled to remain with the program the entire school year. 'The 
. ^dond group of EBCE Program students attended the local Kanawha County 
, schools^ during the first semester and enrolled in the EBCE Program^t 

during the second .semester (n=45) . > 
' ."^o addit^qnal groups of Kanawha County, students were randomly 

drawn^so tha^ comparisons , could be made. One group is a random sample 
^pt senior students^ enrolled in a Kanawha County Cooperative-Wdrk Study 
^Educatfona^L Prgigram. This program is offered to students in five of 
the eleven county' high schools; # random sample of 75 students was 
^dray^Fi from all ^five schools. The second cOTiparison group is a random 
sample of 120 sei^^^r students enrolle^d in the eleven Kanawha County 
high schools. The samples in both cases were stratified by the size 
6f^ the high school. / - ^ . ^ ' . ^ 

B« Analyses of^pata \ ' , 

•ftie initia^^^t of analyses* described in this section used the pre- 
test; data that were coHectec} in Septembe't: and October. The genei>al 

' ■ « * • \ 

concerns addressed by these analyses were Mr\how comparable are the 



two- non-equivaljnt comparison groups^ to the EBCE "group in therms of ■ 
the sele^ed input and criterion variables and (2) w!iat interrelation- 

-4 . • ^ • ■ \ • 

Ships exist .ainorig the different criterion variables. ThVfirst concern 
was addressed the e;>cecution of a multivariate analysis o^ariance. 
^he major 'independent^ variable in this analysis related to the'^ree 

" " - • ' ■ ' . ' ' ' 

different gjoups;of students. The multiple dependent variables were\ 
the^ moire continuous variabiisgt The; dependent variables in the first 
analysis were the, Career Maturity Inventory, scales from the Confidential 



■ y 



student ^Questionnaire /^Educational Development Se^ties tests, at ten- 
dance ratios, andsgrade point average. , ^ 

A second analysis , ^which was a principal components analysis, was 

\ 

conducted to examine the J&iterrelationships between the various criterion 
variables. The initial analysis was followed by an orthogonal rotation 
so .that intercriteria similarities could "be identified. 

"The last set of analyses, to be condifcted in the summer, 1974, will 

deal with total design concerns including^ the following: 

^> 

1. Has exposure to EBQE, the COOP Program, and the regular 

( 

.school program been differentially effective in terms of , 
gains in students' goal-related performances? . 

2. Are variations in EBCE-related process variables significantly , 

relatid to dif f-erential gains in students* goal-related per- j 

i ^ 

formances? / 

/ ■ 

3. Has the EBCE Program in ' terms of its structural goals been 
realized? ' 

The proposed basic analytical technique is the multivariate analysis 



of variance. The major independent variable is the group condition var- 
iable. The major dependent variables will be the gain scores observed ^ 

in relation to the more continuous variables in the criterion set. 

•J . , ^ 

C. Hypotheses to Be Tested 

V ^ ■ 

The ba's'ic hypotheses to. 'be tested include the following:^ 
1. ' EBCE^ students will become more knowledgeable of the world 
^ of work than the students from either^ comparison group. 
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2. EBCE students will be more capable-of locating and 
acquiring worJc^an the students fronf either compari-^ 
son group, 

3. EBCE students will ^^o '^s well as the students from ^ 
iSi^Jier comparison group on academic^ro.wth . ^ 

A. EBCE^ students will be more positive in their attitude 
^ toward the world of work than the students from either 
comparison group* • 

5. EBCE students will be more capable of. planning for 
tl?eir future than the studejits from ei1:her comparison* 
group. ^ • ^^^.^^^ * . 

6. EBCE students will be more capable ,of solving the 
problems confronting them in reaching their goals 
than the students from either comparison group. 
EBCE^ stiidents will be more' capable of appraising the 

levant capabilities of others than the student 
thcr comparison group. ^ ' 
EBCE students will be more able to choose *real is ti.e ' 
career goals than the students from eirther Gcxnparison 
group. , . , , 

EBCE parents will have a positive attitude toward the* 
EBCE Program. * " ' ^ 

Employers (ie.', resource persons, 'contact persons, and 




managers) will hav^^^ip^i^ive ^tit^ae toward the EBCE 
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11. EBCE students will have a positive attitude toward ^ 

the EBCE Program.' - * . 

12. Labor union officials will have a positive attitude 
toward the EBCEr-Program , 

13. Kanawha County school officials will endorse 'the EBCE 
Program. "* ' * . - - 

- 14. West Virginia State Department of* Education officials 

wili^ endorse'^-^h^EBCi; Program. \ 
15. There will be a lower relative frequency of school 

dropouts from the EBCE Program than from the Kanawha 

^ ^ County Schools, 

IV. INSTRUMEJlTS ^^D TESTING TIMELINES 

S^tandardized instruments find specially constructed questionnaires 
ar^ b^ing used to measure the criJ:erion variables identified in the-- 
hypotheses listed in part III. This part describes these instruments^ 
and questionnaires and the tSgmelines for' administration/ scoring, data 
analysis ^ajad^i'eporting. 




A. Standardized' Instruments 



Among stancjc^rdized psychological arid eSv^ational Instruments are 
the,$^?* The Caredr Maturity Inventory;, the Iowa Tests of Educational 
Development, ^h^ ^hlevement^jsf^ttery Os^ Educational ^evelopment^§ 
Series; and the^Stud'erl^Inf ormation S,ystem, Confidential Studei/t Que^ 
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1. Career Maturity Inventory ' ' ■ , . ' ^ ^ * , . 

* ' . ' > / . •v'. , ' ^ • , 

* Various aspects of dtreer maturity will .be measured -with the - ' 

Career Maturity Inventory which has bepn co;istructe<i to measure ^ ' <, 
the maturity of attitudes and ^c«npetencies 'needed to make real- 
istic career choices. ,1^16 (SMi has an Attitilde- Scales and a 
Competence Scale. Itie Competence Scale consists of ^ubscales > 
in the areas of self-appraisal, occupational information, goal" ' ^ 
selection, planning, and problem solving. The' Att;itwde. Scale 
consists of f if ty ^attitudrnal statements* The reliability 
coefficient for the Attitude Scal^ is .75 for 12th graders 'and - ' ' 
.74 for the overall mean. Evidence of ci^it^rion-related valid- 
ity, content validity, and cons;truct validity is presented in 

An. ^ 

the Theo3;y and Research Handbook which accompanies- the test ' * * 

1 - - ^ ' 

* battery. Reliability evidence has b^en collected on the Com- . ^ 

' I ^ , • 

petence Scafw^uid ranges from a lew of .73,. to a-high of .90 

for 12th griadcL students. I^ridence of validity is presented in 

tho. Han ^ok . " ' ^ .^^^ h ' ' \'\ 

, The^ittitude Scale was designed to , elicit the t^elings., sub-' 

_ j'ectivd reaof:ions, and dispositions that the individual has toward / 

making a Career choice and entering^ the world of worl^. • :v. " 

The Competence Scale .was designed to assess the , following five ' ' 

competencijas: Part 1, Knowing Yourself j- how well the individual » 



,^ ^ ^. , ^ — ^ ^.w>>.v^,^w^ , Career Maturity 

Inventory . Moriterey, Cafifori^ia:. CTB/McGrawnHiil, 1973. ^ ' 
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can appraise job-related "activities; Part 2, Knowing About Jobs - 
how much the individual knows about the world of work; Part 3, 
Choosing, a Job,- how adept the individual is in matching per- 
sonal characteristics with occupational requir^ents; Part 4, 
Looking Ahead - how foresight ful. the individual is in planning" 
for a career; and Part 5,. What Should They Do - how effectively 

he individual can cope with the problems which arise in the 
course, of career development. ♦ * 

2. Iowa Tests of Educational Develojoment (Achievement Battery) 
.'The Iowa Tests of Educational Development (ITED) will be used 
,to measure achievement growth. The ITED consists oOf seven tests 
,from which the Siollowing ^even growth scale values can be drawn: 

Reading, Language Arts, Mathematics, Social Studies, Science, Use, 

of, .Sources, and Composite. The cdmposite growth score is expected 

• • - .. .-V ■ • • • ^ 

to be utilized most .heavily in comparing the overall achievement 
growth of the students. Curriculum specif ic growth scales will be 
used to detbrmine the effect of activities in various cur2«lculum 
^,.-^"1^' Coefficient^of. reliability for the ITED range ?ran a low 
of ^90 to a hiCfh o§ .9J for the 12th grade. Evidence of content 
validity, criterion-related validity, and construct validity is 
presented in the SJRA Assessment Survey Technical Report. ^ 



science Research Associates, Inc. Iowa Tests of Educational 
Development. SRA Assessment Survey , Technical Report . Chicago, 
Illinois: Science Research Associates, Inc., 1972. 



9S 
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3. Educational Development Series 

The Educational Development Series (EDS) is an achievement 

battery consisting of ■ six tests. It was used to obtain -achieve- 

ment data from the EBCE students cmd the comparison group .Students 

in FY 74 as well as results of the FY 73 testing. Scores were 

obtained in Reading, English, Mathematics, Science /THeTISS^in *y 

the World, and Solving Everyday Problems. Coefficients of 

reliability fot the 12th grade EDS normijig samples range from a . 

low of .84 to a high of .90. Evidence of content validity" and 

criterion-relatea,'^vaTi^ity is V^esented in the Educational 

Bev^^lopment Series Technical Report . ^ 

■««. • * 

4 

4. student Infonrtation System, Confidential Student Questionnaire 
The Student Information System, Confidential Student Ques- 
tionnaire (CSQ) will be , used* to provide behavior change data .on ' 
the stud^ts. The CSQ is a highly flexible instrument for whfch 
the following scales are being sgored: Cognitive Skills,- Learning 
Attitude, Social Adjustment, Maturity, Personal Adjustment, Flexi- 

.bility. Reality, , and Vocational Readiness. Coefficients of reliabil 
ity for the CSQ scales range from .82 on Part II to .90 on .Part I. ^ 
Procedures for establishi*ng validity evidence* are presented* in the 



Manual of Student: I^^rmation System . ^ 



Iftfoi 



^Scholastic Testing Servic4. Educational - Development Series Tech- 
nical Report - Senior Level T|ensenvi lie, Illinois: Spring, 1972. V ' 



^BehAvioxal Consultants^ • Manual of Student' Information 



Salt Lake City,- Utah: Behavioral Consultants, (undated) ! 
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' * Specially Cojristructfed Questionnaires' . \ 

< ' <' ' ' ' ^ 
, Specially constructed questionnaires used to assess the attitudes 

and .opinions of special sxabject grprugs Vtoward ' the EBCE Program are 

these: EBCE_J973' Graduate ^eatioiuiaire, EBCE Student Opinion Surv^^/.-'^ 

E^E Parent Opinion Survey # ^Employer "Questionnaire, an<l,.§^dent Infor- 

ma^tion Questionnaire. ^ ' ' - 

1. EBCE 1973 Graduate^'g^s^ionna^ . \ ^ 

The EBCE Graduate Questi^onnai'ri^ was designed to^htain infor- 
mation from FY 73 EBCE gra^ffe^ of ,the ef\ects/'ofthe program on . ' 
^ getting/work and further ^tira4.ning '^^^ge-Ap^endix A-1) • The instru- 
ment Was\ designed so that all FY. 73 graduates v^iird respond to tha 
f irsi: section (white) . All "^respondents were then progrcimmed on the 
last item either to complete the Fost Hi^ School Training Questipn- 
naire (green) , \q complete the EBCE Graduate Employment Questionnaire 
(l^lue) ^ or to stop.^ Those respo^i^ents* going to school ofily were to 
I ahswer the white and tho green qestiohnaires. Tho'se respondents 

workjm; only wrrc> ^-o lnnfiw^r the white and thr blue quoGtionnairn?; . 
•Those students working and going to school were to ^inswer all- three 

♦ 

questionnaires . ' 

Thfe questionnaire, cover^ letter , and return envelope were sent 
the last known address of all FY 73 graduates in December, 1|73, 
Vff second mailing was made to non-respondents in January, 1974.. 



s 
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/ 2\ • ElBCE Student Opinion Survey 

/' A -^he Student Opinion Survey (see Appendix A-2) was designed to 
assess EBCE- students' attitujdes toward the EBCE Program, including 



their opinions of: the effects}' strengths, and weaknesses. The ♦ 
-instrument Was developed by the.EBCE evaluators froiii the Appa- ' 

lachia Educational:XabiDratory, Iric^_,thaPar West Laboratory,. 

the Northwest Laboratfecy, Research vW Better S%Jols, Inc., and 

from the Career Educatiqn Program o"f\the National Institute- of 
^Education. Evaluators from the EBCE "program at Research for 

Better Schools were given'^tke primary re^nsibility of drawing 

up tl»e initial dnd'- final dirafits^f the instrument. All EBCE 

% \ ^ ( ' > ' 

evaluators met to critique,'discuss, and revise the instrument 

before the devel^ent of the filial draft. The iTistrument was 

\ * . 

..designed to be used by all four EBCE- Programs to collect mid-year 
,-data from EBCE students. 



r. 



3. EBCE Parent Opinion Surve/^ \ 
The Parent Opinion Survey (see 'Appgn^dix'^^r waV d^^ to 

* ' * - -^*^rrr* * '^"^ — ^ 

assess EBCE parents' attitudes toward- the EBCEVrbgram, incluijig, . 
their opinions of the effects, strengths, and weaL-^gif'^ihe"^ " 
instrument was developed by the EBCE evaluators froA^'SrfSppalactiia 
.Mucational Laboratory, Inc., the Fax West Laboratory, lih|jorth- 
^west; Laboratory //Research for Better Schools, Inc., ^^froirt'i^e . 
.(^& ^ducatip;i Program of the National. Institute of Educkl;i|i^. 
Evaluators from the.'EBCE Program at the Research for Better Scli&s 
were given the primary respoksibility of " drawing up the initial an^^ 



final drafts of the iristrbnent. All EBCE evaluators met to critiq^e\ 

'1 ' - 

discuss, and revise the instrument before the 'development of the 
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final draft. The instrument was designed \o be used by all ' 
four EBCE Programs to collect mid-year data from EBCE parents, 

4* Participating EBCE Employer Questionnaire ^ / 

, The Employe;r Question^iaire (see Appendix was designed 

8 

to assess th^ attitudes of employer resource persons toward the 
EBCE Program. The instrument was developed by the EBCE evaluators 
from ,the Appalachia Educational Laboratory, Inc, the Far West 
Laboratsty,. the Northwest Laboratory, Research for Better sdRools, 
^nc, , .and ^ from the Career Education^rogram of the National Insti- 
tute of Education, Evaluators from the" Appalachia Educational 
Laboratory ,| Inc , were given the responsibility of drawing up the 
initial a^nd final drafts of the instrument. All EBCE evaluators 
met to^cfiiique, discuss, and revise the instrument before the 
developcien^t of the ^nal draft. The instrximent was designed to 
be used byj al^ four EBCE Programs to* collect mid-year employer 
data, Thd evalpator^ill review and revise the instrument before 
It IS administered a second time. 

5, Student Information Questiormaire- 

The Student Information Questionnaire (see Appendix A-5) was 
designed l^y thfe NIE/CEP evaluation staff. It is used to gather 
data on student sex, race, grade liivei^^and parent education and 
occupation. In addition, the questionnaire seeks information Tfrom 
cin their current curriculum and expected activities follow- 



students 



ing completion of high school. 
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C. Testing Timelines 

^ * The schedule for test adm^istration, scoring, analysis of data, 

and reporting was modified by changes in the evaluation design made 

in September,^ 1973. Figure Instrument Administration Schedule, 

, shows the timelines followed to March 1, 1974, and testing tiiaes planned 

for the spring and summer of 1974. -^Pret^sting in the fall of 1973 was 

^ extended into. October to accommodate^^school sc^dules with the-'cooperativ 

Work Study sample and the random sample from al? Kanawha County schools. 

Final testing of both the fall and niid-year EBCE students on standardized 

measures will take place on April 22-23, 1974. This relatively early 

date fits well with the Kanawha County school holidays. ''It vlill enable 

■ ■ . f 

students to have greater continuity of experience site placements and 

to attend senior year acUvities during the last month of _school. 

V. STUDENT POPULATIONS 

Questionnaires and tests were administered to all Experien6e-Based 
career Education (EBCE) students, the random sample of Kanawha County 
12th grade studcntsnRANDOMj , and^€he random sample of Kanawha County 
12th grade students 1lri the Vocational ,.bcJoperatiVe-Work Study (COOP) 
Program xn order tp establish the comf^ability of groups; /students 

were administered all instruments ^itHin the time interval of September 

i 

15, 1973 through October 15, 1973. This part, based on pretest data, 
includes a report of demographic data! and statistical comparisons of the 
three groups. It should be noted the! EBCET -llth grade data are presented, 
hut no comparisons were m^de with anylother group because of t"he small ' 
n (n=5) included in the sample .Is^. ^ 



InstTunMirts 
& Subject SamplM 



1973 



S«pt, 



Oct, 



Nov, 



1974 



Fib. 



Mtroh 



Apnl 



Miy 



Jun« 



Aug. 



I S. LQ. 



EBCE-Fall 



Co-Op Sample 



KCHS Sample 



EBCE Mid- Year 



5E C.IVL I. 



EBCE-Fall 



Co*Op Sample 



KCHS Sample 



EBCE Mid-Year 



E. D, 



EBCE-Fall 



Co Op Sample 



KCHS SajT^pli 



EBCE Mid-Year 



E. D, S- 



EBCE-Fall 



Co-Op Sample 



KCHS Sample 



EBCE Mid- Year 



s. |. s.-c. s. a 



EBCE-Fall 



Co-Op Sample 



KCHS Sample 



EBCE Mid- Year 



s.o.a 



EBCE-Fall 



Co-Op Sample 



3i 



1 1 



I I 






t 



KCHS Sample 



EBCE Mid- Year 



PSirent Opinion 
Ouettionnajre 



nwionnain 
i Empldyer Opinion 

QMfttjgnniift 



Graduate Questionnaire 



FollowUp Questionnaire 



ERLC 



Figurt 2-2 



/ 



i 



, Table 2-3 

A Sumnuiry of the Pad^g-round- Characteristics 
of the Selected Students 



Variable 



Possible 
Responses 



Sex 



Race 



Father's 
Occupation 



Mother's 
Occupation 



Male 
Female 

White 

Black 

Oricjital 

Spanish Descent 

Native American 

Other 



n=5 
Grade 


EBCB 

n^-45* 
11 Grade 12 


' COOP 
n^G4 


llANIX)M 
SAMPI.K 
r^llO 


Total ' 
Grade 12 
n^217 


% 


% 


\ 


% 


% 


60.0 


39.5 


45.3 


46.4 


44.7 


40.0 


60.5 


54.7 ' 


53.6 


55^3 


100.0 


88.4 


90. 


90.9 


90.3 . 


0.0 


9. '3 


6.3 


5.5 


<- 6.5 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


2.3 


o.p_. 


0.0 


0.5 


0.0 


0.0 


1.6 


2.7 


1.8 


0.0 


0.0 


1%6 


0.9 


0,9 



Clerical 


0.0 


' 4.7. 


0.0 


Cra fLMnan 


0.0 


11.6 . 


19.0 


Farmer,. Farm 


/ °-° 


0.0 


0.0 


Manager 




Hccnenijkor 


, 0.0 


0.0 


0.0 


Laborer 


0..0' 


16.3 


9.5 


Manager |. Adm. 


' 40.0 


18.6 


12.7 


^tillLary 


0.0 


0.0 ^ 


1.6 


Operative 


20.0 


• 25.6 


19.0 


Professional 


20.0 


18.6 


14.3 


Proprietor or 


20.0 


0.0 


^.5 


Owner 






Protective Ser. 


. 0.0 


0.0 


♦ 3.2 


Sales 


0.0 ^ 


0.0 


3.2 


Service 


0.0 


0.0 


3.2 


Technical 


0.0 


0.0 


4.8 


Other 


0.0 


2)3 
2\S 


0.0 


Oon't Know 


0.0 


4-0 



Clerical 
Craftr^man 
Farrtv^r, FaiTn 

Manager 
Honv*mriV^cr or 

HouiJdwi f e 
Lal>orer 
Man age r» Aclm. 
Mi 15 tary 
Operative 
Professional 
Proi^rietor or 

Owricr V 
Protective Ser. 
Sales 
Service 
Technical ' 
OUier 

Don*t Know 



40.0 
0.0 



24.2 
1.6 



1.9 
12.4 
0.0 

1.0 
14.3 
13.3 

1.9 

ir.4 

21.0 
7.6 

2.9 
2.9 
4.8 
3.8 
1.0 
0.0 

13^ 
0.> 



1.9 
14.2 
0.0 

0.5 
13.3 
14.2 

1.4 
16.6 
18.5 

6.6 

2.4 
' 2.4 
3.3 
3.3 
0.9 
0.5 

17.1 
1.0 



0.0 


0.0 


0 


.0 


0.0 


0.0 


0.0 


45.2 


43 


.5 




49.0 


0.0 


2.4 


0 


0 


0.0 


.0.5 


20.0 


2.4 


1 


6 


1.8 / 


1.9 


0.0 


0.0 


0 


0 


0.9 ' 


0.5 


0.0 


2.4 


1 


6 


2.8 


^2.4 


20.0 


21.4 


11 


3 , 


13.2 


14.3 


20.0 


2.4, 


1. 


6 


1.9 


1.9 


O.-O 


0.0 


0. 


0 


0.0 


0.0 


0.0 


2.4 


9. 


7 


3.8 


* 5.2 


0.0 


M.8 


4. 


8 


4.7 ' 


4.8 


0.0 


0.0 


0 


0 


1.9 


1.0 


0.0 


0.0 


0 


0 


0.9 


0.5 


0.0 


O.'O 


0. 


0 


0.0 . 


0.0 
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Table 2-3 (Continued) 



Variable 



.Possible 
Responses 



n=5 
Grade 11 



n«45* 

Grade 12 



COOP 
n=64 



RANDOM 
SAMPLE 
n=110 



Total 
Grade 12 
n=217 







% . 


% 


> % 


% 


% 


•father's 


None 


■0.0 


0.0 


0.0 


/ 0.9 


0 5 


Education 


Elementary School 


0.0 


9.3 


6.3 


6.4 




•35 


Some High School 


0.0 


20.9 


21.9 


24.5 


23.0 




High School Grad. 


40.0 


[\ 23 . 3 ' 


42.2 


27.3 


30.9 




Some Post- 


0.0 


11.6 


20.3 


13 .6 


15. 2' 




, Secondary^ . 














College Graduate 


0.0 ^ 


16.3 


7.8 


14.5 


12.9 




Some Grad. Work 


20.0 ' 


11.6 


1.6 


5.5 


6.0 




Advanced Degree 


40.0 


2.3 


1.6 


6.4 


4.1 




Don't Know -or 


0.0 


4.7 


0.0 


0.9 


1.4 




Blank 












Mother's 


None 


0.0 


0.0 


0.0 


0.0 


f 

0.0 


Education ' 


Elementary School 


0.0 


4.7 


S.l 


,'2.7 


3.2 




Some High School 


0.0 ' 


16.3 


25.0 


' 17.3 


19.4 




'High Sdiool Grad. 


40.0 


41.9 


41.9 


48.2 


j45.2 




Some Post- 


0^0 


18.6. 




16:4 


17. 5^^^ 




Secondcury 






18^8 




8. J 




• College Graduate 


20.0 


7.0 


7,8 


10.0 « 






SOTie Grad. Work ^ 


^ 0.0 


7.0 


0.0 


OiS^^ 


1.8 




Advanced Degree 


40.0 


. 2.3 


'3.1 ' 


3.6 


3.2 




Don't Know or 


0.0 


2.3 


o.d- 


0.9 


0.9 




Blank 













*The statistics presented were generated via a missing Qata procedure and as a 
result tl\e ^n's vary slightly across items. 1^ values indicated are the modal 
sample sizes - the ranges in the ss^fltple sizes iwere'as follows: 

(a) ^ EBCE: 44 to 42 . ' £ 

(b) COOP: 70 to 59 • , ^ 

(c) Random: 114 to 102 n * 

(d) Total: 228 to 204 . , ' 
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, Table 2-5 * ' , . ' 

A Brict Sumjnary of the rrelitninary Career Choices of Sample Students 



Variable 



Responses 



EBCE 



Greido 11 
n«5 



Grade 12 



KANDOM 0*0 
COOP SAMPLE Grade 
n-0 4 n=3lO n=2l7 



de T?* 



liOng-Rjingc ' 


C]/i»cu] 


20,0 


7.0 


GOiils 


Cr«?ft'.m.)n 


0.0 > 


4.7 






» ,0.0 


4.7 


• "■ ♦ 


^ Hcmrin.iKt I (>i llotr.^w) f(> 


0.6 


0 . 0 






-0-0 


7.0 






0.0 


7.0 




Military 


0.0 . 


' 0. 0 


e 


Oj)ervitiV(; ^ 


0.0 


0. 0 




Prof rscion.il 


20. 0" 


37. 2 




Proprietor or Owner 








Protective Service* 


-0.0 


2.3 




Sales 


0.0 


2.3 




Service 


0.0 


0.0 




Technical 


0, 0 


7 ft 




Other 


0 n 


/ . U 




Don't know 


60.0 




• * 

ExiHjctations 


« 

Working Full Tjme 


80.0 


-25.0 


a Year Hence 


Entering Aj>pronti ccship- 


0.0 


6.6 




Type Prog rain' 








Military Soj'vjce 


0.0 


2.0, 




Full-Tiioc Hoiin*m,»kPr 


0.0 






A^tondinq Trvh. , Voc. , 


0.0,, 


2.3 




f tC. , 5.(1), >ol 








Junior o»" Comm. colloge 


0.0 


i.s 




(AcvkIohi I c) 








Junior oi VtMnm, Collrtjo 


0.0 


0.0 




(Terluii cmJ ) 








Foui -yotir College oi 


20.0 * ^ ' 


30.4 




UnlVi'i;,ily 








Working Pm i-T»m(^ 


0.0 


2.3 




OlIUT 

1 


0.0 


ir..9 


Miijor I'jold 


(•(•lU'i^jl Orr ) )culnm 


« ■> ^ 
tiO.^ 


5U.1 


of Study 


VocatSj^^nnl rd CurrUAilum 


,'20.0 


7.0 


1 


College prep Curriculum 


20. p 


27.9 


— • 


'other !' ^ ^ 


0.0, 


7.ff 



V 



1?.5 
.9.4 
3.1 
l.C^ 
0.0 
4.7 
0.0 
1.6 

39.1 
0.0 
1.6 

. 1-6 
0.0 
6.3 

12,5 
6.3 

20.0 
2.9 

4.3 
0.0 
5.7 

^5 .'7 

5.7 

37.1 

1.4 

17.1 

30.5 
15.3 
49.2 
5.1 



10.9 

9.r 

4.5 
0.0 
1.0 
1.8 
2.7 
43. G 
0.0 
1.8 
1.8 
1.8 
4.5 
8.2 
6.4 

20.2 
1.8 

3.5 
1.8 
4.4^ 

1.8 

2.6 

49.1 

7.0 

7.9 

33.3 
IV'.G 
48.0 
fl.O 



10,0 
8.3 
2.^3 ' 
2.C 
1.4 
3.7 
0.9 
- 1.8 
41.0 
0.0 
1.8 
1.8 
0.9 
5.5 
9.2 
7.8 

2r.i 

3.1 

3.5 
1.8 
4.4 

3.5 

3.1 

43.0 

4.4 

1?.3 

37.7 
14.7 
44.1 
3.4 



*Thc Stat 15^ tics pre rented wcn> genefSled vTa 
across i tpn*^ . The* values ind3(atod nro tho 
follow^: (a) EPO:: 44 to 4P , (ft) COOP:. 70 



a missing data* procedure aiy^ as a result the n's vary slightly 
mfKlaKsample sizes^ - the ranges in the sample si 7.es were as 
to S9, (c) Randowi 114 .to 102, andMd) Total: 228 to 204. v 

. ■ \ . 
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Table 2-6 

The EBGE Students' Ma^or Reasons for Joining the Program 



'Response Options \ 



Observed Percentages 
11th Gradfe 12th Grade 
n=5 n=43 



Dissatisfied with l§st year's school program 
Want thore information on careers 
Want a more personalized program 
I heard it's. an easy program 
Other \ 



0,0 
80.0 
20.0 
0.0 
0,0 



30.2 , 

18.6 
7.0 
0,0 



At ■ 

\ 



J 
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Table 2-7 



Summary of Pretest bfeta 



* Grade Point Average 



9th Grade, 1st Sc^itestcr 

9th Grade, 2nd Sewfstcr 

10th Grade, 1st Scinc'.tcr 

10th Grad^<?, 2nd Semester 

11th Grade, 1st Semester 

11th Grade, 2nd ScjnoGter 



Attendance Ratio 

9th Grade 
10th Oracle 
11th Grade 



1972-73 LDS 

Non-Verbal 

Verbal 

Rendxng'i 
' English 

Mathcmatxcs 
'Science 
, USA in %hc Wotld 

Solving Everyday r 



*1973-74 EDH 

Reading 

Mathomatics 
Sclrnro 

ur.A In tho World 

Solving rvcrytlny ]»n>hlrmn 



CMI 

i 

Atti t ude Scale 
Knowing Yourself 
Knbvving About Johs 
Qiqo<;ing 'a Job 
Looking AJioad 
"WJiat s)^^)uXd Hicy Do 




CSQ 



CognitJ^e Skills 
licaining Attitude 
Social Adjustment 
Mnturj ty - ' 
Personal Adjustment 
FJrxjhi'Uty * 
Reality 

Vocational Roadinesn 



EBCK " 


COOP 


Kandom 






n«44 


n= 


70 




=114 




P ^ 


X 


\ SD 


X 


SD 


X 


- SD 




2.18 


.69 


2.46 




2^05 


-81 


6.20 


7~ 

.01 


2.24 


.74 


2.53 


.73 


2T68 


.77 


5.45 


.01 


2.14 


..74 


2.38 


.71 


2. Si 




4.09 


. 05 


2.04 


.77 


2.26 


.•70 


2.55 


i .85 


7.31 


.001 


2.06 


.79 


2.414 ^ 


.73 


2. 61 


. 83 


7.71 


;00] 


2.27 


.77 


2.4^ \ 
* 


.78 


2.6] 


. 89 


2.71 ' 


. 10 


.93 


.06 


.96 


.04 


.96 


-04 


5.24 


.01 


.91 


* .08 


.95 


.04 


.96 


.05 




. 001 


.89 


.10 

1 


.93 


.08 


.94 


.06 


8.04 


. 001 


32.85 


7.32 


• 34.2^'' 


' 7.16 


34.90 


8-36 


•1.08 




30.58 


10.30 


30.10 


. 9.51 


• 32.89 


XO-95 


1.81 




'37.38 


12.20 


36.8)2 


10. •f5 


40- 72 


12 - 59 


2.73 


\io 


4IB4.24 


10.80 


34.96 


10.63 


37,45 


12.00 


1.74 


22.61 


«,72 


23.4:} 


7.65 


26-40 


10.15 


3.76 


-05 


33.10 


10.80 . 


33.31 


10.55 


3G-21 


12-75 ' 


1.84 




31.60 ^ 


11.48 


31.63 


10.78 


34* 32 


12. 51 


1-49* 




34.63 


8.97 


35.48 ^ 


7.62 


35-66 


9.47 


0.22 






1 




















4^ 










-30.37 


5.85 


37.09 


5.05 


38- 32 


6-99 


1.84 




30.06 


4.44 


31.31 


5 . 87 


33 . 55 


i 6.83 


4.30 


. 05 


26.67 


4.40 


28.07 


3-50 


28-55 


6-01 


2.18 




30.92 


6.36 


37.59 • 


6.13 


39-17 


5-91 


1.54 




34.06 


5.67 


35.60 


6.16 


35-77 ' 


6.05 . 


0.62 




36.76 


3.70 


38.11 


4.69 

? 


37-24 


4.81 


1.3] 




3^s51 


5.18 


37.60 


4.19 


36.48 


5.60 


4.93 


.01 


13.69 


3.66 


14.31 


3.10 


14- 48 


3-49 


0.86 




lG.3fi 


3.54 


16.97 c 


2.75 


17-22 


3-07 


1.17 




13.05 


3.04 


14.26 


3.24 


14.50 


3.23 


3.32 


.05 


12.80' 


3.77 


14.67 


2.89 


14-11 


3-60 


. 4.03 


-05 


1] .^0 


2.99 


12.52 


2.82 


12-45 


3-24 


' 3.27 


-05 


25. 4D 


8.25 


28.29 


7.95 


27-84 


7-28 


2.01 




15.7^ 


3.97 


17.31 


3.67 


17.87 , 


3.63 


5.40 


.01 


61.52 ^ 


12.72 


65.74 


12.12 


63^ 72 


11-33 


1.75 




35.06 


7.06 


38.70 


6.63 


30. 68 


6.29 


5.14 


.01 


34.00 


7.43 


37.64 


7.B3 


35.60 


6.84 


2.62 


.10 


20.31* 


5.45 . 


22.26 


4.^0 


2] .94 


5.06 


2.26 




* ■30.14 


8.36 


32.06 


9.71 


33-01 


8-18 


» 1.73 




46.7^^5 


■ 7.04 


49.33 


8.46 


49-49 


8-22 


1.90 





«^df uitod is (?,22r>) 
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Student demographic data w6re obtained for all students f rom^ the - 
Student; Information Questionnaire (see Appendix Aj*) and fronf student 

■ ^ : ^ 

permanent records. Data from the^e sources wejre cdded and tabulated. ' 

\ ' ' ' . * ' ' * 

Sumi^iaries of the tabulations are presented in Table 2-3. The variable 

, • \ 

j^ems are identified in Column I, the possii^e answers available f or • 



each item in Qolumn Z, and frequency of response ih tKe form of- a 

^ . • ^ ^ 

percentage in Columns 3 through 7". • • 

A; Sex, Race,, and Parental Data Comparisons \' .j 

A review of the data contained in fable 2-3 revealed that th^ three 

groups of student^ were^very similar iai terms of 'sex, race /and pa-r- ? 

ental education and (pupation. ^ The niajor .difference aj^Jearetl .^n the ^ 

amount of parents' formal education. .The EBCE, mothers and fathers Md \ * - 

slightly more formal educatioi> 'than'"either of the two comparison groups' 

parents (see Table 2-4). A second difference was the mothers' occupations 

* • • /* ' 

It appealed that, a larger perbent of. EBCE mothers were in professional 

occupations than the- mothers from'eitffer o^^^-^e two comparison -groups. 

mei-o wore no apparent differences between the two \:ofnparisbri groups * 

wLtJi respect to parent education ^d occupation. » 



B. jStudent Goals, Grade §bint Average, Attendance, an^ Achievement * 



Comparisons • ^ 



Data from the questionnaire and from' student permanehtNrecora files 
on student goals, gra^e point average "(GPA) , at4:endance hi^Jory, and on 
the 1972-73 achievement test results (197^-73 ms) .were* ctm^cr'ted'. ^ - * 
Tables ^?r5/ 2-6, and 2-7 contain summaries of these data. Statistical ^ 



tests * (Univariate Analysis of Variance) weire %)plied to id^tify 
differences or. similarities • of the three groups on GPA, attendance , 
ratios, and on the 1972-73 EDS. / 

1 . Goals ; 

During the previous school year, more EBCE students were 

J ' 

enrolled in general curriculum courses than Vere students in 

either of the comparison groups. However, fewer EBCE student^ 

were enrolled in college preparatory courses than were, students 

in either of the comparison groups during the previous V^ar. 

Slightly tfewer than one half of the EBCE students (44%) joined the 

program to obtain more information about careers. Approximately 

orie third of the EBCE students indicated that their primary reason 

for joining the EBCE Program was ^dissatisfaction vith their home 

r 



2. Grade Point Averag 



A grade point average (GPA^^was calculated-f or every EBCE stu- 

dent and for each of the comparison group studentsv Credits^ for- 

♦ ' . ' j> 

music, physical education, student council, and other extra-curricular 

activities were not included in calculating the GPA. Credits for 

art, crafts, driver education, and for 9th grade music wereji^included 

« 

in the GPA calculations. The EBCE students had a significantly lower 

9 ^ \ 

GPA than the random comparison group. " Although the EBCE GPA score 
was lower than the COOP GPA s^re, the difference was not signif^ant 
except for the first semester of the 11th grade. The two comparison 
"groups were not significantly different on CPAs. 

e 

! ■ ' ' . ■ ■ ' 



Attendance ■ . S ' . , • 

* * . I • ' . 

An attendance ^ratio was calculated for each student by diViding^^ - 

' the total number of days present by the total possible attendance 

\ 

, days for the student in a Kanajvha Comity school. The EBCE atudehts 
had a significantly lower attendance ratio than the students from' » 
either of the two comparison groups* f'or each of the preceding three 
yevs. -^o differences were found in the attendance ratios of the 

students from the two comparison groups. 

* - ' . ' ' ^ ♦^-^ ' 

4. Achievem^eht 

students in West Virginia are administered a state-wide 
achievemeri^plt battery ' (Educatiorial .Development Series) diii^in^ 
their 11th grade jear. i:hese test data (19^72-73 EDS) were analy^^ed 
over all three groups for each of the test components. 'Although 
Significant differences for mathematics (a=.05') and reading (a=.10) 
resulted from the univariate analysis, the Scheffe' method did not ' 
isolate the location. of the differences between the three groups. 
It should be noted that there was a definite .trend indicating'^e 
EBCE and th^ COOP students' scores were very similar and somewhat 
lower than the random group student scores. 

C. other Comparisons 

The EBCE students and^'the comparison group students Were administered 
the following instruments near the beginning of the school year: (a) 
career Maturity Inventory (CMI) ; (b) Student Information System, Conf i- 
dential Student, Questfonna.ire - Level II (CSQ) ; and (c) random sections - 



. / Table 2-8 

Sdieffe* a Posteriori Comparisons* ^ 

T^: 



EBCE cod)'? . RANDOM 



GPA -t-.;9tti Grade,. ]Jat S.emester 2.18 2.4§ 



GPA -;.pt:h Grade, 2nd^; Semester ^ 2,24 ^j-S"^ - 2.68 

GPA - lOpi Grade >,JLst ]§Vmester ' ^ ^2>1 4 2.3g 2^5^ 

' ^'dPA'- 10tii-.Q^acJeV-'4n^ ^ . 2^^.04 - Zrg e^^ 2.55" 

GPA - llth.Grade^ Xst Semester.;^'. ".^ - '^TOe ^ 2-,'44' .2^61' 

GPA -^llth ^Grade^, 5nd'^Semester » . '\ .-2.^7 ^-'2"*4k'*^ 2,61 

Attendance Ration:,, 9!th '^r^^^ • • ^^^.^-^f^ .,93 .96.- .96 

Attendance' Ratiq^iflth Grade" "^T . .-9^. .95 .96 



Attendance Ratio -;*^il4at. Grade ' . ^89' .^93 .94 

1972-73 EDS - Reading '/.V. ^ ' - * 37.38 . .3^.82 ' '.40.72 



/ 



4. . 



1972-73 EDS - MathemaUcs^v:-/.".' • . - 22.61 23.43/ 26.40 \ 

19^-74 EDS - English / ... ■ ' 30.96 31. 3i 33.55 

• j:mi - Attitude Scale. ^ ', , . M,..5i 37.60 26,.48. 

^ CMI - Choosing a Job-s%^^ - \ , - ji^.OS^ • 14.26 14.50 

' ' ' - ■ 

CMI - Looking Ahead 

cm -- What Should They DgK, 

CSQ - Learning Attitude 

CSQ T Maturity 





' 14.67 


14.11 








12.52 


12.45 


15.71 


17.31 


17.87 
39.68 


35.96 


38.701' 



ERIC 



CSQ - Personal Adjustment* r34.66 ^ 37.64 35.69 



*Thos6 means not grouped together by th^^'aitte type of line are, significantly 
different at the .05 level (Sche'ffe Compairisons) , e.g. Mi ' M>p M-' 
Means 1 and 2 are not significantly different from each other an^TmeanF 5^ 
and 3 are not significantly different from each other, but Mean^ is \ 
significantly different from' Mean 3. . ' 



' of the Educational ,peX?eiopment Series (EDS) achievement test battery. 
A multfvariat-e' analysis of vkriance was used on these variables and 
certain 'demographic variables '(see Table 2-7) to determine how com- 
^ ^ Parable the two groups were to the EBCE students at the beginning of 
-"the school ye.ar. The Sependent variables were -the three groups of' 
students; the- independent variables .were the 37 listed in Table 2-7. 

The analysis established-that the" three groups of studehts were' 
different. A multivariate F of 1.69 was significant at a = .01 ' ' 
df;^ = 74; df2 = 378. Consequently, a univariate analysis of viri^ance 
was applied to each of the 37 variables over the three groups of Stu- 
dents. The F value for each variable is- printed in Table 2-7 with the 
, accqmpanying probability level if .10 or less. 

» • - * 

Sigoificant differences were found in the following variables; GPA 
(all- six time periods) ; attendance ratio (all three time periods) ; 
/l,972-73 EDS • (mathematics and reading sections) ; 1973-74 EDS /-English 
section); CM.I, (attitude and Parts 3, 4; and 5 of the competence test); 
yand c^Q (lea^^ing attitude, maturity, and ^x^rsonal adjustment factors). 
- . Tho Schotfo:; method wa.s applied to each of th.^ variables to identify 
;where the significant differences were ideated. Results can be found ' 
•iH.^able 2-8. .Those me^ns not grouped together by the same line are 
si-gnificantly diVfeVent .at'the^^ level. As k gene^l trend the EBCE ' 
students were significantly Iciwer than the r^dom comparison group. As a 
general trend tHd two comparispn- groups were not significantly different. 

- The 'Iowa Tests/of Educational Development (ITED) was administered 
tofall EBCE students. Raw scores ^ind percentiles based on Rational 
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d5i 



norms are presented in Table 2-9. The data indicate that the EBCE 
students on the av^age scored below the 50th percentiJ^e on national 



norms « 



D. A Test 'ijbr Overlap Among Variables 



A '^princJLple components factor analysis was performed on all 37 
variables aivj over all] students. The rotated factor matrix was exam- 
ined to determine ^ow much overlap there was over the various xnstru- 



V f / 

,ments used. Eight^ factors emerged with an eigenvalue greater* than 1. 
^ jThe* eight factors accbiinted for over 73 percent of the total variance, 
' J ' A, summary of the major variables composing each factor with their fac- 
tor loadings is presented in Table 2-10, An examination* of the eight 
factors reveals that 36 of the 37 variables had a factor^ loading of at 
least .50 on a factor and that only one variable had a substantial load- 
ing on more than one fafctor./ The factors can basically be named by the 
5 various instruments .used to collect the data. This would seem to be 
indicative of very little overlap of the^various instruments andean 
indication that the instruments used do account for a large proportion 
of the to^r variance of the students. 

VI. FINDINGS OF SUMMATIVE EVALUATION TO Mi^H 1, 1974 

student Opinion Surveys Wre ad^jlhistered to all Experience-Based 

' V ^ * * ' ^ ^ 

Career Education students at tjiie end 'ot.tiie first semester (January, ' 
v. " ' 

1974) ; the EBCE Graduate Questionnaire was administered to all 1973 

* ? 
EBCE graduates. Parent Opinion Surveys wera'sent to parents of first 

/ semester students. Employers who had* worked with students the first 

<^ . ■ ■ ■ 

37 _ 1 . 

Er|c ' ' df; 



Table 2-9 



Descriptive Characterization of EBCE Students in Terms of 
the Iowa Tests of Educational Development 



* 

t 










11th 
n 


Grade 
=5 




12^ 

n= 


Grade 
40 


Raw 

Score 

Mean 


National 


Raw 

Score National 
Mean Percentile 


Reading Ccmprehens 


ion 






24. 


40 


37 


26. 


65 


35 


Vocabulary 








16. 


00 


31 


23^ 


53 


31 


Total Reading 


■ 






40. 


40 


34 


47. 


18 - 




Usage 








21. 


20 


25 


24. 


00 


30 


Spelling 


J 






9. 


60 


12 


16. 


64 


26 


Total Language 


Arts 




• 


30. 


80' 


15 


40. 


64 


24 


Mathematics 








9. 


40 


28 


11. 


73 ~ 


35. 


Social Studies 








21. 


80 


40 


23. 


13 


33 


Science 








20. 


60 . 


25 


24. 


95 


34 


Use of Sources 








18. 


60' 


31 


22. 


43 




Composite 








N. 




27 


N. 




30 


-i 
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Tablo 2-10 

Factor Loadings for fhc Thirty-5;cvfn Variables Included in protest, Adoiinistration 





1 


2 




3 


Factor 
4 5 




6 


7 




8 


CPA - 9th Grade , 1st Senestcr 


-0.468 


-0.139 


-0 


102 


0.079 


-0. 1Q4 


0, 


278 


-0.087 


-0 


.648* 


GPA - 9th Grade, 2nd Semester 


-0.421 


-0.082 


-0, 


083 


0.107 


-0.05^0 


0. 


265 


-0.093 


-0 


.729* 


CPA - 10th Grade, 1st Semester 


-0.321 


-0.062 


-0, 


065 


0.116 


-0.069- 


0. 


273 


-0.052 


-0 


.791* 


GPA - 10th Grader 2nd Sencster 


-0.249 


-0.056 


-0. 


111 


0.176 


-0.050 


0. 


233 


-0.006 


-0 


.802* 


GPA - 11th Grade, 1st Semester 


-0.267 


-0.165 


-0, 


152 


0.107 


-0.129. 


0. 


208 


-0.035 


-0 


.767* 


GPA - 11th Grade, 2nd Sencster 


^-0.239 


-0.039 


-0, 


112 


0. 105 


-0.087 


0. 


194 


-0.063 


-0 


.763* 


9th Grade Attendance Ratio 


-0.100 


-0.067 


0, 


007 


0.781* 


0.039 


0. 


188 


0.093 


-0 


.117 


10th Grade Attendance Ratio 


-0.068 


-0.061 


-0, 


129 


0.843* 


-0.010 


-0.004 


-0.075 


-0 


.136 


11th Grade Attendance Ratio ' 


-O.OfG 


0.019 


-0. 


094 


0.835* 


0.029 


-0.032 


-0.019 


-0 


.247 


H 1973-74 ELDS - Reading 


-0. 189 


-0.002 


0 


076 


-0.050 


-0.844* 


0. 


181 


0.053 


-0.090 


1973-74 e'i>S - English 


-0. IBO 


-0.053 




053 


O.OOJ 


-0.800* 


'0.099 


0.053 


-0 


.192 


1973-74 LIX^ - Moth 


-O.r^30* 


-0.130 


0 


000 


0.050 


0.203 


-0.026 


0. 214 


-0 


19 3 


1973-74 EDS - Science 


-0.371 


-0.004 


-0. 


111 


-0.009 


0.241 


0. 


420 


0.313 


-0 


.017 


1973-74 hUS - USA in the World 


-0.320 


0.017 


-0.070 


0.015 


O.OOl 


0.088 


-0.817* 


-0 


.103 


1973-74 LDS - ?o3vjng PrN>)rfn-. 


-O.JIS 


-0.007 


-0.018 


t-O.015 


0.067 


0. 


279 


-0.807* 


-0.088 


1072-73 KDS - Ncii-Verbal 


-0.^94 • 


-0.000 


0. 


004 


0.097 


-0.071 


0. 


327 


-0.176 


-0 


.213 


1972-73 Kns - Verbal 


-0.7G9* 


O.OOB 


-0. 


020 


0.045 


-0.158 


0. 


358 


-0.126 


-0 


.237 


1972-73 ZDS - KCdding 


-0.71G* 


-0.047 


0 


017 


-0.023 


-0.100 


0. 


310 


-0.055 


-0 


.214 


1972-73 r-lS - English 


' -0.G22* 


-0.050 


-0 


123 


-0.012 


-0.273 


0. 


347 


-Ov037i 


-0 


.324 


1972-73 EDS - f*at]i 




-0.090 


-0.006 


0.120 


-0.034 


0. 


143 


-0.113*^ 


-0 


.230 


1972-73 EDS - Science 


f 0.799* 


-0.032 


-0, 


057 


0.092 


-0.144 


0. 


274 


-0^147 


-0 


.231 


1972-73 EDS - USA in the Korld^ 


-0.781f 


-0.052 


0. 


001 


0.077 


-0.132 


0". 


299 


-0.a67 


-0 


.204 


1972-73 EDS - Solving Problesss 


-0 . 567* 


-0.081 


0, 


0C6 


-0.018 


-0. 119 


0. 


555* 


-0.151 


-0 


.260 


CMI - Attitude Scale 


' -0.230 


-0.il9 


-0, 


134 


0.049 


-0.051 


0. 


632* 


-0.100 


-0 


.302 


OH - Knowing Yourself 


-0.186 


-0.083 


-0. 


119 


0.046 


-0.046 


0. 


747* 


-0..048 


-0 


.135 


CMI -^Knowing About Jobs 


-0.308 


-0.095 


-0.070 


0.018 


-0.092 


0. 


788* 


-0.006 


-0 


.139 


CMI - Choosing a Job 


-0.287 


-0.097 


-0. 


104 


0.026 


-0.098 


0. 


712* 


-0.070 


-0 


.190 


Oil - Looking Ahead 


-0.177 


0.009 


a.oi6 


0.116 


-0.074 


0. 


737* 


-0.164 


-0 


.205 


CMI - What Should They Do 


-0.325 ' 


-0.083 ' 


-0, 


102 


-0.010 


-0.104 


0.661* 


-0.121 


-0 


.265. 


CSQ - Cognitive Skills 


-0.194 


-0.801* 


0. 


017 


-0.039 


0.048 


-0.038 


-0.011. 


-0 


.130 


CSQ*- Learning Attitude 


-0.091 


-0.775* 


-0, 


163* 


-0.026 


-0.018 


p. 037 


0.007 


-0 


.'253 


CSQ - Social Adjustnent 


-0.026 


-0.866* 


-0.001 


0.002 


-0.060 




214 


0.036 


-0.008 


CSQ - Maturity 


-0.000 


-0.183 


-O.0D2* 


0.073 


-0.122 


0. 


285 


0.069 


-0 


.153 


CS^ - •Personal Adjuytnont 


-0.036 


-0.85«J* 


0 


160 


^0.081 


-0.040' 


0. 


155 


-0.037 


0 


.045 


CSO - Flexibility 


0.024 


-0.150 


-0. 


737* 


'0.085 


0*043 


-0. 


160 


-0.136 


-0.068 


CSQ - Reality ' 


-0.0?1 


0U38O 


-0. 


757* 


0.073 


0.115 


0. 


073 


-0.040 


-0.048 


CS^ - VocatiiMuil 




-0.150 


-0. 


775* 


0.035 


-0.072 


0. 


321 


0.052 


-0 


.139 


Eigenvalue » 


13.074 


4.725 


3 


110 


2.334 


1:702 


1.623 


1.359 


1.229 


Proportion ol Variance (rcrcrnt) 


32.09 


11.81 


7 


77 


5.84" 


4.40 


4. 


04 


3.40 s 


3 


.07 . 



t 

•Scales which prinarily 'dcf jtio faciox-.. 



4^ 



semester responded to an EBCE Employer Questionnaire. This section 
contains a report of the 1973 graduate of the ''.EBCE Program, a "report 
of the attitudes toward the EBCE Program of" the first semesteri^s^tudents, 
and reports of the attitudes toward the EBCE Program, of parents and 



employers . 

A. Attitudes of 1973 Graduates Toward tfie EBCE Program ^ 



1. Administration and Description of Questionnaires " f 

A- questionnaire (see Appendix A-1) was sent to 44 1973lgraduates 
in December of 1973. Twenty-f ive- of the 44 graduates resp^ided, to 
the initial request. ^'A second letter and questionnaire wer% sent 
to the non-respondents on January 25, 1974. The second mailing 
resulted in nine more returns. This report is a summary; og; the 
results of 34 of a possible 44 questionnaires returned by Wie 1973: 
graduates. ' " ^ f 

The EBCE Graduate Questionnaire contains thr^ parts'. '?rhe first 
part (white section) is a general section consisting of ten questions 
used to^describe characteristics of the total sample. , The second 
part (blue section) contains 18 questions designed to elicit infor- 
mation concerning students' present positions, attitudes toward those 

positions, salary levels, and how beneficial EBCE had been to thtem. 

•J. 

The third part, (green section) has nine questions ' and asks for 
information about present and future plans for ttaining, difficuflty 
in getting into" school , and' the effect of EBCE on chosen Career. 
The general section was completed by all students. The green . 



section was completed only by those students receiving 'further 



Table 2-11 

Summary of EBCE Graduate Questionnaire 
(n»34) 



1^ Marital Status 

28> Single 
^ 2 Engaged 
4 Married 



0 Marx)iad, Separated 



0 Divorced 



2.r How many full time^ jobs have you had? 



v.- 



11 None 



15 One 

3 "Ewo 

4 Three 

1 Four or More 



3.- With whom do you live? 

25 Parents 

1 Relations 

2 Friend (s) 



1 Alone 

4 Husband or wife 



4. HcM often have you voted in a public election?* 



16 None or n6t old enough 

8 Once 

4 Twice* 

2 Three or more times 



5. Are you a volunteer worker for organizations? 



5 Yes 



8 No, But I'd like to 



21 No 



0 



6- When you look back and pompare the course of your career so far with people 
about your age, are you , * s 



Respondents going to schbol only j 
Respondents working only v 
Respondents work and going to school ^ 
Respondents nftither-^ working or going 
to school 



^ Frequency 






Much Less 


Much Mpre 






Satisfied 


Satisfied 






1 2 


3 / 4 


5 


X 


SD 




i 5 


0 ' 


3.30 


0.95 


0 1 




3 . 


3.69 


0.95 


0 0 


! : 


3 


4.33 


0.82 


• 0 2.^ 




2 


3.60 


1.52 



Table 2-11 (Continued) 
♦ * ♦ . 

7. When* you compare. how the rest of your career is likely to turn out witU how 
the careers of people about your age are likely to turn out, are you: 









Frequency 




V 










Much 


Less 


Much 


More 










Satisfied 


Satisfied . 












2 ^3 


4 


5 ^ 


X 


SD 




^phool only * ' 


0 


0 , 2 


4 


4 


4.20 


0.79 




Work orfly- 


0 


;i 4 


5 


3 


3.77 


0.93 




School and Work 


0 


'0 2 


3 


1 


3.83 


0.75 




Neither 


0 


' 1 1 


3 


0 


3.40 


0.89 



c8. Show how satisfied you^>ire. with each of these types of career achievement. 



School only ^ • 

a. Certainty of my career goals 

b. Adiievement of my career goals 

c. Overcoming of difficulties in 
tny pareer | 

<f. Path fSllowed tbw^rd career goals 
e. Spee dr oved toward "career goals 

Work only ^ 
a. "Certainty of y^areer goals ' 
, b . J^<^ ie vem en t of career goals . 

c. Overcoming of difficulties 

d. Path' followed toward career^oals 
e» S peed moved toward career goals 

School and work 

a. Certainty of career goals 

b. Achiei^ement of career goals 
Cj Overcoming of difficulties, 

d. Path 'f^lloygd toward career goals 
'e. Speedy ri|o\^^^, toward career goals 



Neither w6rk nor sdi09jr 

a. Cert^pity of care'jst goals 

^b. AcQl'&vement ^of career goals 
rooming of difficulties 

' P^^th f9llowed toward career goals 
fc' 9t>eed moved toward career goals* 

YL ■ ; 



Frequency 






Very 






Very 






Dissatisfied 


Satisfied 






^1 


2 


.3 


4 




X 


SD. 


1 


1 


6 


2 


2.90 


0.88 


- 0 


4 


4 


2 


2.80 


0.79 


0 


2 ' 


6 


0 


2.75 


0. 46 


2 


0 




3 


2.90 


1.10 


2 


3 


2 


2 ' 


2.44 


l.MT 


0 


3 


• 4 


6 


3.23 


0.83 


0 


4 


5 




► 3.00 


0.82 


'\0 


1 


7 


3^ 


3.15 


0.55 


' 0 


2_ 


5 


4 


3.18 


0.75 


0 


4 


6 


3 


2.92 


0.76 


0 


0 


4 


2 


3.33 


0.52 


0 w 


, 1 


4 


1 s 


3.00 


0.63 


0 


1 


2 


3 


' 3.33 


0.82 


0 


1 


3 


2 


3.17 


0.75 


1 


' 0 


3 




3.00 


i.io. 




i 










0 


2 


a 


2 


3.00 


1.00 


1 


1 :% 


1' 


2 


2.80 


1.30 


1 


2 


0 


2 


,2.60^ 


1.34 


1 


2 


1 


0 


'2.00' 


0.82 


1 


2 


2 


0 


2.20 


0.84 



ERIC 



^5 
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Table 2t11 (Continued) 



Show how much effect the EBCE program mjay or may not have had on you. 





Frequency 






Strongly 




Strongly 








Disagree 




Agree 








1 

X 


z 


3 


4 


X 


SD 


EBCE helped: 

* 














School only 














a. Prepare me for work 


1 


1 


4 


3 


'3.00 


1.00 


b. Prepare me for college 


i. 


z 


3 


4 


3.00 


1.0^ 


c. Me become 'a better person 


n 
u 


A 

*k 


4 


2 


2 . oO 


0 . 79 


d. ^ Develop my mind 


1 


"J 

J 


c 
D 


1 


Z . bU 




^ e. In personal adjustment 

• 


n 


J 


c 
D 




2.90 


0 . 74 


Work only 














a. Prepare me for work * 






8 


5 


3.38 


0. 51 


b. Prepare me for college 




J 


7 


# 1 


2.67 


0.78 


c. Me become a better person 




U 


10 


3 


J . Z3 


r\ A A 


d. Develop my mind 




U 


D 


b 


J . DU 




e. In personal adjustment 

< 




U 


b 


/ 


3. 54 




School^ and Work 














a. , Prepare me for work 


0 


0 


3 


3 


3. 50 


0.55 


b. Prepare me for colleget. 


0 


0 


5 


1 


.3.17 


0.41 


c. Me become a better person 


0 - 


0 


1 


5 


3.83 


0.41 


d. Develop my mind 


0 


0 


1 


5 


3.83 


0.41 


e. In personal adjustment 


0 


0 


2 


4 


3.67 


0.52 


Neither School nor Work 














a. Prepare me for work 


.0 


1 


2 


2 




0.04 


b. Prepare me for college 


1 


1 


2 


0 


2. '2 5 


0.96 


c. Me become a better person 


0 


0 


3 " 


2 


3.40 ■ 


0.55 


d. Develop my mind 


0 


0 


2 


3 


3.60 


0.55 


e. In personal adjustment 


0 


0 


2 


• 3 


3.60 


0.55 



training. The blue section was completed by all students presently 
working. There were, therefore, four. types of returns:, those stu- 
dents completing only the general section and the green section, " 
those students completing ^^^^ general section and the blue- 
section, those students completing all three lections, and those 
students completing only the general section. Table 2-11 is. a 
summary of responses to selected questions and is organized to 
present the different responses of each respondent group. 

2. Findings ' \ ^ * 

Items 6 an^l attempted to determine how the graduates , felt 
about the past and future course of their careers. The mean 

* ( 

response was "as satisfied" or "more satisfied" in every case. 
However, those students who were working and going to school were 
much more satisfied than the other groups on j:he course their career 
had taken so far. When queried on the futu|yp|| their career, the 
students only going to school were most satisfied whereas those 
students neither going to/school nor working were least satisfied;. 

Item 0 sought information about various aspecl^s of caroer 

/ 
I 

achievement. The trend of the item means indicated that the students 
going to school and working were m<fst satisfied with their. career 
achievement whereas those students neither go^g to school nor vork- 
ing were least satisfied. All groups were least satisfied with the 
speed with which they have moved toward their career goals. Students 
neither going to school nor working were somewhat dissatisfied with 

< 

44 , 



Very 

Dissatisfied 



4.00 



3.50 



Somewhat 3.00 
Satisfied k 



2.50 




Sk)mewhat 
Dissatisfied 



2^0 



1.50 



' School and Work 
Neith«r t 
Work Only 
School Only 



Very , 

Satisfied » 



' 1.0O 



8a 



8b 



8c 



8d 



8e 




2, > 

O fl> 
of < 



3 



o o 

o o 

c o 

?. 3 



o « 

I? 

of 



i ^ 

S 8. 

°- 2 

• (D Q 



Figur* 2-12 
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Attitude of EBCE Graduates Toward Career Achievement 



Table 2-14- 



, Suyranary of Post High School Training Quest^ionnciire 

(n=16) ^ 

What type of training program are you now participating in? 
School Only School and Work • * 



9 



4~year college or university 
junior or community college 
vocational or technical school 
business school 
trade school 



What is the main training program' you plan to complete? 

School ^ly School and Work ^ 

\ 2 some college 

Q 0 junior or community college 

Q • ^ - 0 vocational or technical school 

Q ' * 0 trade or business school 

^ ' .0 4- year college 

3 ^ - 2 Master's degree 

Q 1 Doctor's degree 



now much difficulty did you have in getting in the' school? 

School Only School and Work 

iO ' t ^ None . 

0 . 0 Some 

. 0 0 A great deal 

What is your, main reason for going to school? 

4 

School Only School and Work 

9 > . 4 To pursue a chosen career 

' ^ 1 To find' a caree:p 

' 0 . 0 Could not find work , 

0 . 0 Did not know what else to do 

• Q 0 Parent or friends pressure 



How well did the EBCE program prepare you fox your training program 
School Only School and Wjark r 

^ ' 5 Very helpful 

5 1 Somewhat helpful * \ • ' 

' 1 0 ' Not helpful 



47 



Table 2-15 'I 

Summary of EBCE Graduate Employment Questionnaire 

(n=19) 

■' ' / 

How many full time jobs (30 or more hours per week;) have you Jield since* you 
left the EBCE. program? • ^ 

Work Only Work and School \ '{'r 

0 ^ ^ 3 None ■ . , ^ . 

7 2 1 full-time job" ^ 

2 . ' 1 2 full-time jobs" _ * , • 

4 0 V 3 or more fu3jl-time jobs 

How closely your first job after graduating relate to your .EBCE experience? 

Work Only Work and School ' ^ 

~ ! — ' — " — - ^ 

^ ' • 3^ I was employed in an occupation in which I 

had EBCE experiences. , ^''ic^ 
2 2 I was employed in a r-elated occupation. ^ 

Q 1 I was employed in a- completely different . 

occupation. • 

Did ,the EBCE program adequately prepare you for your finest ^ob? '^^rrr- 
Work Only Work and School 



J. 



_10 • 5 Yes 

NO 



7 



What was your beginning hourly wage on *t±e first job you tiad after graduation? 
Work Only Wor4< and School ^ - . ' . ^ « . * 



0 




$1.60 to $1.99 j^T 'hol^- u 
$2. OA to $2. 49/ per hout >a"^V 

$3.00 Wii*^ per ho^^^^;r--r^^^':<^~: 

$4.00 or more per '•J' «'>.• V «. '• , 



.r hpur\ 

How did you. get your first job after leaving *the EBCE prograip^ Vi-V 



Work Only Work and School 



il , 2 ' I got the job myself 

Q 1 ' My family or friends helped me get the 'job. 

2 ^ » 1 , The/EBCE program helped me*get the job.. 

Q 0 'An employment agency helped me get the job. 



Table 2-15(Continued) 



What is your pjresent hourly ^age? 



Work Only 



Work and- School' 



0 



••3 



$1.59 or less per hour 
$1.60 to $1,99 per ho\ir 
$2.00 to $2.49 per hour 
$2.50 to $2.99 per hour 
^3.00 to $3,99 per hour 
$4.00 or more per hour- 



. Whaff.iis'ycJ^i i^ain reason for -working? 
Wqj^c 'OAlr^ - r . Work and School ^ 



4v 



2 ' 



V 



Support self or family 
E3^erience V 
To have a career 
It's intere'sting 



11." V^uld you' like to work at yeur present job 5 years from'now| 



Worj: -Qh^y 
3 



Work and* School 



^ 0 



/ 



2' 



initj/l 



;o ' 



Definitj^ly 
Probabiy 
Uncertain 
Prgbably not 
Definitely not 



* 12, How many hours do you work a week (averse)? 



Work Only 

o' 



"Work and School 



0- 



. 1 



X 8 



13. 



l-« hours 
5-flO hQurs 
' ll-20" hours • 
21-30 hours 
31-40 hours 
'bvefS&^h ours 

/// ^ \ ■ 



How much dif faulty did you have ge^zting work? 



Work Only 
8 



Wojic and School 



/ 



' r 3 



Jf 



No di'fficulty 
Some difficulty* 
Much difficulty 



ERLC 



^49 



Table 2-15 (Continued) 



14. Would you rather have some other job^-^ 
^ Work Only Work ^d School 



. 6 



' 2 



Yes 
No 



IS. Have there been any jpbs you tried for but didn'Jb get?" 

Work Only. ' ^ Work and' School 

7 3 Yes * 

No 




/ ^ 



'■■i 



ERIC 



50 



.•Table 2-15* ^Continued) 



' 16. Below aio listed so?wc ^Irnu. dosv i ibVinj v»iriou8 ar.pecta of jobs. Plcosb circle for coch itq^# 
• tho nutnlier that bc«t flortc-ribes how^-^tinfli^d you arc wi th^ aspect oC your present job. 



* Frequency 



Work and School 



Very Very 
i)i;;sa^. Satis. 
1 2 3 4 5 



a. Earnings 

t 

* h. The duties of the job 

c. Jdb security ' 

d. The amount of responsibility I have 

e. The ajnounC of variety m my work 
, f . The amount of prestige I have 

g. • Tho degrdc of difficulty of my worK 

h. The work load 

i. Opportunity for promotion or 
advancement 

j. Benefits (insurance^ sick' pay, 
pension plan, etc.) ^ 

k. 'opfortunities to use my initiative 
or' judgment 



Opportunities to use my knowledge 
and ability 

Opportunities to shore interests 
with those io my line of work 

Getting along with fellow workers 

Getting along with those under me 

Getting along with other peoplo 
I mret in my work 



q. The kind of supc»v»<;or 1 have 

r. Opix» t uni tics to rmmoge or siipeivise 
other people and ocLAvitics 

f \ • ' ; 

8. The deg»}e t^which my job enables 

mc to Itve th^kind of life I want 

t. Opportunities tA benefit others 
through my work ^ 

u. Physical working conditions 

! 

•V, Opportunities to bo cJoative and , 
inventive 

*w. Oi)ix>rtunil i OR to do a gtvxi job 

V 

•K. My skill at working wi Uf jvoplc 



5 3 

-3 1" 
3 ' 1 

3 1 
2 2 

4 0 
2 3 

2 2 

3 0 



2 1 

5 A- 

2 6 

2 7 

2 6 

3 6 

4 4 

a 

2 5 

0 . 6 



3 1116 



2 4 115 



3 3 2 1 4 



2 4 3 4 



0 0 2 11 
1 9 
0 0 4 9 



0 0^ 



0 2 0 ^9 

3 2 3 3 

'2 2 2 3 

2 1*17 

2''l 0 8 

13 3 1 

1-0 0 10 

0 0 2 9 



2.62 
'3.77 
3.69 
4*00 
3.77 
3.85 
3.77 
3.67 
3.25 

3.50 

3.23 

3.00 

3 .'69 

4.85 
4.90 
4.69 

4.33 
3.33 

3.00 

3.92 

3.77 
2.54 

4.42 
4.50 



SD 



1.15 
1.12 
1.43 
1.24 
1.37 
1.29 
1.05 
1.37 
1^79 

1.71 

1.58 

1.57 

1.07 

0.36 
0.30 

0. 46 

1. ?5 
1.31 

1.53 

1.44 

1.62 
1.39 

1.32 
1.12 



Frequency 


Vory 




Very 






Oissat . 




Satis. 






1 2 


3 


4 


5 


X 


' SD 


1 Q 


1 


2 


2 


3.67 


1.37 


0 '1 


> 


. 2 


2 


r.83 


1.07 


0 0 


1 


1 


4 


4.50 


0.76 


0 0 


2 


1 


3 


4.17 


0.90 


1 0 


2 


0 


3 


3.67 


1.49 


0 0 


2 


3 


1 


3.83 


0.69 


0 0 


2 


2 




4.00 


0.82 


0 0 


2 


1 


3 


4.17 


0.90 


2 0 


0 


1 




3.20 


1.83 


1 0 


2 


0 


2 


3.40 


1.50 


* 1 1 


1 


1 


2 


3., 33 


1. 49 


1 1 


0 


2 


2 


•a cn 
J . 


1 . 50 






A 






0 1 




3 


4.00 


1.15 


0 0 


0 


2 


4 


4.67 


0.47 


0 0 


1 


2 


3 


4.33 


0.75 


0 0 


0 
« 


3 


3 


4.50 


0.50 














2 0 


0 


1 


2 


3.20 


1.83 


0 1 


2 


1 


2 


3.67 


1.11 


2 0 


0 


1 


2 


3.20 


1.83 


1 0 


2 


1 


2 


3.50 


•1.30 


1 0 


0 


2 


1 


3.50 


1.50 


1 0 


1 


1 


2 


3.60 


1.50 


1 0 


1 


1 


3 


3.83 


1.46 


0 0 


1 


2 


3 


4.33 


0.75 
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the *path they have fallowed toward, their career\aals (s^e Figure 
2-12).* / :v. ; 



Item 9 sought information on the effect of the EBcV^rpgram on 
students. The^ trend of • the item m^ans indicated that-the students 
going to school and working agreed vecy strongly that EBCE had a 
positive effect on them. Those students only going to school were 
. least Ftositive pn ail concepts except preparationVfor college. 
Those students neither going to school nor working w^^ somewhat 
negative on the extent which EBCE prepared them for college *j(see 
Figure 2-13) . , j' ' 

Sixteen students responded to the^Post High School Training 
Quesfionnaire (see^ Table 2-14). Ivelye of the 16 students were 
going, to (a four year college or university, and two of the students 
were going to a vocational or technical school. Pour ^students plan 
to complete'some college; three plan to attend four , years of college; 
and one plans to complete a doctor's degree. All -respondent^ indi- 
cated they were eithec going to school full time ten students) or^ • 
going to school and working (six s^dents) . None of-:the students had 
difficulty qot ling into school. Thirteen wore going to school to * 
pursue a chosen career whereas two of "the students were try^ing.to 
find a career. FiV^teen students felt that the EBCE Progiram had been 
at least somewh^ helpful in pre^ring them for their training pro- 
gram. Only one of the sixteen felt the E9CE Program had not been 
/helpful. ^ 

According to the EBCE Graduate Employment Questionnaire (see 
Table 2-15), nineteen student?^Were either working fulli t^ne (13 



students) or working arfd going to school (6 students).* The respon- 
dents indicated in Item 3- that ten of the job sites were either ^ites 
in which they had an EBCE placement or "were relate'd sites; nine indi- 
cated they were working in a completely different ppcQpation* Fifteen 
students indicated that the EBCE Pi^^^^^^^^^e^ately 'f>repare them 
::^errl:heiT first^ job/ Only three of the respondents in Item 5 indir 
cated that the EBCE Program helped them get their first job. In Item 
2, nine respondents indicated that their first job after graduation 
was thd same or similar to the experience sites In which they were 
placed while in the program/ nine others indicated that their first 
job Was completel/'different. Eleven of the respondents indicated 
in Item 11 that 'they would not like to work in their present job five 
y^rs from now. Items 13 and 15 provided information on the degree 
of difficulty*- the students had getting work. Eleven indicated they 
had no difficulty whereas eight had some difficulty. Ten of 18 had 
been turned down for a job for which they had applied. The responses 
to Item 16 irtdicated that the students were quite satisfied with most 
asjA^ctfi of their work. They were least satisfiod with salary and 
tho amotknt of initiative or creativit^ they wore allowed on the job. 

' ' / 

Students had a chance to respond^xo an open-ended question" solicit- 

^ Vv 

ing'thed^ thoughts about, changes that, should be made in the EBCE Pro- 
gracm. Although the responses in general were very positive, there 
was a preponderance of respondents indicating a need foj^^more site's / 
-a chanc'e to be placed at more sites, and a chance to be in the program 
for a greater length of time- ^ . 
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Table 2-16 



Summary of Data From Student^ Attitude Questionnaire 
(n»44) 



Definitely 
No 
1 2 



Frequency 



Definitely 
Yes ' 
5 



Mean 



Standard 
Deviation 



SD 



1. Havo you 1jKo<1 attending the Career 
Education I'rogram? 

2. If you hnd it to do over again, do 
you think you would decide to 

" participate in the Career Education 
Program? 

3. Have the activities available in the' 
Career EducaLx Program been inter- 
ne sting to you? 

.,4.j^ Career Education Progrtim have 

you felt that you could progress ^at ^ 
ycur own rate? 

5. Have you Lccn much of »i relationship 
between your activities in Uic learning 
center and' the caicers you liavc learned 
about . 

6. Do you get enough feedback i^out how 
well you tiro <k>ing xn thi- pxogram? 

7. TOve you-li.nd ei^ough choice in deciding 
the'amoiuit of time you spend at omp3oyer 
sites? 

8. Have you had enough choice in deciding 
the, amount of time you spend in learning 
acaidemic subjects? 

9. Have you had enough choice in deciding 
what*you do at employer /re source sites? 

10. Have you had enough choice in selecting 
the types of employer/resource sites 
you visit? 

* 

11. Do. most people receive much satis faction^ 
from thcirt»pik? 

12. bo you think Hinrt if a person workc 
hard enough, he can adtlove anything? 

13. Do you think that the main reason a , 
person work;* is to earn enmigli money 

to livoV . 

14. ,..ln general, are you* looking forward to 

workijig in^a joJ>? 

< V 

15. Do you think you h.ive mucH choice of 
occupations? - . *- " 

\ 

16. In gennral, were the employer/resource 
pe I Sonne I involved the Career 

* * Edu cat ion .Program aware of your needs 
and interest •<? " ' 



-0 ' 2 



0 1 



2 6 



16 



> 3 14 



6 20 



1 20 



8 20 



8 11 



1 17 



2 23 



11 18 



2 ' 13 



10 22 



4 14^ 



: 1 



8 12 



8 . IB 



10 14 



26 



27 



17 



21. 



14 



19 



20 



15 



13 



^6 



^3 



23 



18 



12 



4.55- 



4.55 



4.20 



4.36 



4.05 



3. S3 



4.16 



4.09 



3,95 



4.47 



3.77^- 



4.25 



y 3^.30 



4.30 



4.19 



3.64 



.59 



.76 

^75 

9 

.83 

1.19 
: .99 

\ .94 

I .86 
\ '.80 

.86 
1.04 
\ 3.15) 

h .85 

,82 

\ 

\ 1.16 
f 
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T«b]o 2-16 (Continued) 



»^ — 

3 




Froqucncy 


1 

Mcrin 1 


standard 
!)eviati on 


1 




Definitely 
No . 


2. 


3 


Definitely 
Yes 
4 5 


X 


> 

SD 


47. 


In gpncral, at employer/resource sites 
did you got to actually do things, 
rathe than just listen? 


1 , 


1 




16 


24 


4.39 


.87 


18. 


In general, have the employer^ resource 
sites you've visited been interested 
in the Career Education Progr^? 


0 


3 


4 ' 


21 
• 


16 


4.14 


' .85 


• 19. 


In general, have you felt welcome at 
the employer/resource sites? 


0 


0 


6 


19 


1.9 


4.30 


.70,^ ' 


20. 


Do mqjit of the employer/ re source sites 
you hePve worked with let you, know how 
you're progressing? 


6 


9 


9 


15 


5> 


3.09 


1.25. . 


•21. 


Through your experiences in the Career 
Education Pro<jram have you learned a , 
lot about opportuniLioc for the future? 


0 


2 


3 




21 


4,32 


.80 


22. 


Do you plan to* get a secondary school 
diploma? 


0 i« 


0 


'3 


0 


^41 


4.86 


/ .51 


23. 


Would you say the Career Educnt;.on Program 
has helped you form career plims? 


1 


0 


- 4 


12 


27 


4.48 

r 


.71 


24. 


Would you say you've learned a lot whilcT 
attending ^e Career Education Program? 


0 


0 




20 


n 


4.41 


.62 




P003f 
1 


2 


3^ ' 


.Excellent 
4 5 


X 


SD 


25. 


How well organized and coordinated do 
you think the Career Education Program' 
has been? 


* 1-' 

. U 


6 


7 


19 


11 


3.75 


1 . 06 ' / 


26. ^ 


How would you rate the general quality 
of the Career E(iucation I'rogram staff? , 


0 


0 


IP 


14 


> 20 


4.23 


1.18 


47. 


How would you rate the pcrsonel counsollng 
available in^ the Career Education Progriim? 


/ 0 


1^ 


8 


9 


25 


4.35 


.87 


28. 


' How would you rate the career counsel ing 
available in tho Career Education Program? 


0 


1 


8 


15 


. 19" 


4.21 

1 
) 


* .83 , 


29. 


•How would you rate tho gcnoral quality 
of tho Career Kducdtion J-rognam cmployor/ 
resource you*ve workr^d wi^h? ^ , \^ 




1 


9 


21 


13. 


4.05 ' 


• 


i 


Not At All 
Important 

1 * 2 


3 


4 


Extremely 
Impoi tant 
5 


X 


SD 


^ 30.. 


t 

How important was each of tho following , 
factors in deciding to joih the Career 
Education Progrota? 










• 


r 






a. I wanted more Crcixlom/independoncc . 


3 » 


3 


8 




21 
t 


3.95 


1.26 
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Table 2-16 (Continued) 



I wanted to choo«o my own^lonining * 
style* 

I Wcuited to It-arn about cnrcorr,, 

I didii t like my previous schooj^, 

I wanted to prepare for a job. 

I was bored wi*tfti school 

I heard the Career Education *i*rogram 
was "teasy . 



Not a2^ii 
In^ortant 
^1. 2 



Freaue 



Extremely 
Importa-Mt 
4 5 



1 
6 
1 
6 
17 



2 

0 

7 ' 
' 1 
7 
6 



4 

12 

;)4 
9^ 



10 

9 
9 

6 

10 



18 

30 
10 
24 
16 
3 



Mean 



4.14 

4.52 
3.23 
4.34 
3.43 
2.44 



Standard 
DGvi«^tion 



Much 
Less 
1 



Ab^^ut The 

2 ta 



4^' 



Much 
ore 
5 



31.*^ In conipUrison with regular schools, 
' how nvuch opportunity did the Career . 
' Education Progriun provide you for 
learning about occupatiortn? 



32. 



33. 



Jn coripaw.s9n wjth regular schools, 
how much opportunity did "the Ca-ccer 
Education Program provide you for ' 
generiil learning? ^ 

In^comparison witli past experiences 
in regular schools, how motiVAtc^ 
are you to learn in the Career 
Education Progr«irn? , ^ , 



4i 
\ 



5^1^12 



J, 



5 38 



18 * 9 



15 21 



4.84 



3.70 



4.30 



34. During tJiis school year have ytfu worked' outside of home, for money? ^ 



A. No ' 

(. 

B. Yes, less than 10 hours a week^. 

C. Ye^, betWecn^C)^nd 20 houxfj, a week. 

"^1). 'Yes, between 20 and 30 houis a week. 

\ 

K. Yes, more t)»an* 30 hours a week. * 



■1 



18 
7 

11 
1 
5 



7 



• •* 'TablQ 2>-J0^(0ontiaiukl) 

35. Bolow are listcU several areas of i)0;;siblc iJhportfinpe for a ;?tiKlont to leam. PleaSe r,Uo r-ach * 

in tot.«-, vf hovr impoiL^a i^ju feel it is t/r n student to Uunu, oiid Iiow\:cU you feel Uu- program 
ib acci)wpli8hiiuj c»^ch. - / • ' • 



Not. MighlS' 
Important ^mportai/t 



Students learn .to: 

a. Perform specific 
occuputibnal 
skills'^ 

b. Be ^junctual and 
organize their 
time. 

c. Assume* respon- 
sibility for 
thcwr. elves . 

d. Makt- decisions 
and folloiv 

. through. 

c. 'Communicate 

• with others'.*. 

* * in a mature { 

way. ] 

f. Be aware of 
more career 
opportunities. 

f 

g. «ork with 
V 'ot>icrs 



h. Evaluate their 
own wc>rk. 



i. Perform ba.sic 
academic ,«;killfl. 

j. Think tJii^Qugh 
' and solve 
1 problems 



How Important Do You 
Feel I'his Ixinrnincj Is? 



Freqv»Gncy 



12 3 



0 0 4 '8 32 



0 1 4 48 21 



0 .1 2 



0 0 0 1^ 31 

Iff 

0 0 1 16' 27 

0 0^ 1 10 33 

0 0 3 13 20 
.0 1 4 14 7'j 

1 0 ;7 10 JO 
0 0 3* 12 29 



Have a por-itive 0 0 0 JO 34 
attitude 
toward self. 



1 . Have d \>o'^i t ivc 
atXitu..lii 
tw.ird woiK. 

m. Hixvr a positive 
attitude . 
, towa rd lo a 1 n mg . 

• n. prepare for 

further educAtiiJn 

\ o. Improve inter- 
personal and 
social skills 



0 0 , 1 13 30 
bo 3 J2 20 

1 1 ,7 12; 23 
0 0 4 12 •26" 



Mean 



4.G4; 



4.34f 



}4.66 



} 

4.70 



4.59 



4.73 



4.57 



4.43 



4.i8 



4.59 



4.77 
4.66 



4:58 



4.25^ 



4.52 
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standard 
Deviation 



SD 



.65 



.75 



.68 



.46 



.50 



.62. 



.76 



.87 



.62 



.42 



.53 



.63 



.97 



.67 
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How Effecti^' Do You Feel the' Project 
H.is Boon in Ac^ on;.aishing llu 3 I^arni ng 



Frequency 



"iU Highly 
Effective ?:ffcctiv 
• 1 2 3 4 5 



0 1 7 22 14 



6 2^ 15 17 10 



0 1 3 15 25 



0, 1 4 16 23 



0 1 3 23 17 



0 O^' 3 « 12 



29 



/O 0 2 13 29 

0 1 6 24 13 

0 0 9 17 17 
, 0 1 5 21 17 

,0 2 7 15 19 

0,1 7 17 .10 

0*' 1 7 16 10* 

1 2 6 17 18 

1 1 lb .li 19 
4 





Standard 


Mer,-: 


Ocvi':»tion 


c 




X 


SD 


4.11 


.75 


3.00 


.85 


4.4b 


.V -73 


4.39 


.75 


4.27 


— * 
.69 




.62 


4.61 


. -58 


4.11 


.72 






3.95 


lr59 




. 174 


•t 

4.19 


, .88 ^ 


4.23 


, .80 




J 


4.21 


.81 






4.11 


.97 


4.10 







.The 1973 graduates were very positive toward the effects of the * 
EBCE Proqram. Those students going to schoojl^nd working responded 
mosji^sitively; those neither going to school nor working respon^d 
le^^t positively. It could be hypothesized that those respondents 



working and going to school know their career goals. Thgre is some ' 
evidence^^o indicate that those respon^nts neither working nor 
going to school have not firmly established their goals ^nd therefore 
are not as satisfied. 



B. BBCECStudent Attitudes at Mid-Year 1973-74 . 

^ - . • y 

1. Administration and Description of .Questionnaire 
' "l^e^Student Opinion ^Suirvey (see Appendix A72) was administered 

to all EBCE students (n-44) who had been in the program for one 
semester during the week of January 21-25. The questionnaire was 
administered to^tudents in large group settings. Students who were 



unclear about any item were able to ask for clarification. 

The Stud<^nt Opinion Survey contains 37 items which a^^mpt to 

determine KHCK student attitudes toward many aspectSy^f . the KBCE 

Program. Student^ responded tcJall items excepty«ems 34, 35, and 36 

by marking a five point Likert type scale, l/^er numbers indicate 

negat^ive trends > higher numbers, positive/trends. Item 3^ attempts 

* ^ • 

to determine the number of hours stud^ts worked during the school 

year. Item 35 asks for informati^ on how a job interferes with 

other activities. -Item 36 requests ' information concerning changes 

o / • 

lb / 

that ^students would like tOy^ee in the Career Education 'Program. A 
summary of the data on selected questions is in Table 2-16. 



2. Findings 

Ini general the data indicated 'that the students were very positive 
about all aspects of the EBCE Program. It is worthi noting the items 
to whiqh the students reacted nuDst positively and ^R^se. items to '. 
which the students reacted leas t^ positively . 6 

Students had very positive feelings toward oattending feBCE (Item ^< 
1) and toward further participation (Iten^ 2). , T^e^meap for each pf 
these items was 4.55 pf a possible high of 5.00. Item 22 indicated 
that students were very sbre about their plans to.|get a secondary ' 
diploma. The mean fo^ this item "was '"4.86. I ^ ^ 

Students were le^st ^positive toward the -f^d^ck -they have 
received from the employer sites (Item 20) . The frequency distribu-^ 
tion on this item indicated that; J.5 students were not satisfied, 20 
students were satisfied, and 9 Stucients were undecided about 'their 
satisfaction toward feedback flrom employer sites. Students al'so 
expressed a certain amount of dissatisfaction with the employers' 
awareness iof the students' needs and interests (Item 16). Data from 
Items 6 and 9 indicated that students were not errtirely satisfied* 
with feedback received in general from ^he program.rand''With the^an^mrYt 

— ^ ^, , - . . • ^^^^ - T^'-^ 

of choice they have in deciding' employer/resouj^ce^ites. ^ ' 

Students indicated in Item 30 'that tehe^ primary, reason /fdr joining 

the EBCE Program was to learn about careers^. Although^ 13 st;'udeni:s 

30ined the program becy[use they heard, it was easy, this, reason was 

givon least frequently. . - • ' 

Items 31,; 32, and^33 provided students an opportunity to compare' 

V . * ■ - ■ ^ ^ ''"'i ' 

perc^tions of the EBCE; Program with perceptions* of*^their home Schools. 

' ' 59 ' : 



The E^CE students rated the EBCE Prograia higher thair- their home - ' 

school on all three comparisons. Opportunities to^ learn ^bdut'-" 

^ \ -^^^ 
occupations was rated Ki^heSt with a mean -of 4.84. Opportunities 
^ ' ' ? ^ _ ' 

*for general learning was rated, lowest with, a^me^n of 3l70/^' 

•^Item 65 was designed to ddentify uhich'^goals stud^ts felt were 
important fo*, the EBCE Program and then to judge the ef f ectiyen^^s* 
of -the EBCE Program dn each of^he goal's. The EBCE students' believe*v 
that all the stated gbals are important. The most iijtportant goal, . ^ 
according to the responses, is "to have positive attitude' toward* 
self.". The least important goal is *'t6 perform basic' academic 'skills. 
The' students rated higftly the effectiveness of the EBCE I'rogram' dij/^ 
all the, stated goals. According to- ^he students, the EBCE ProgVam 
IS most effective on the goal "to work ,with others" and^l^ast effec- 

tive on thQ goaT "to be ptinctual ^alnd organize their time,** 

^ f " ' ^-'-v - / ' ^ 

Students we^e given an opportunity 4:p suggest changes ^ijor 'the ~ 




EBCE Program^ on an* open-ended question.^ The^most consistent 

stion (4 of 24) was to changM|M: examine the point system. of 
grading, A second frequently sjEfteste^ change ^(3 of 2i\ was to -""^^ • 
eliminate the. Career LAPS. Students also indicated' change was 
desirable in the number of job sitfes available to fehdm, information* ^ 
about job sites, and the short length of stay at a' jo5 siteJI . 



Parents^ Attitudes Toward EBCE a^C^End of First Semester ,.^197 3 ^4 

1. Administration and 'inscription of Questionnaires • • 

^ '''' 

A Parent Opinion Survey (see Appendix A-3) was ^pnt to the.* parents 
of each of the 44/ students enrolled in the EBCE Program^^t the end of 



first semester of the 1973-74 school year: Returns were received 

from 29.(66%) of the parents surveyed. One of the , questionnaires 

was not included in the tabulations because of the lafe returji. ' 

The purpose of the Parent Opinion Survey is to father ^^^^v * 

on parents' per9eption3 of various aspects of the EBCE Program. 

The questionnaire contains ,25 itemsr parents ^esponde^' by^' marking ' * 

a five point* Likert type scale or by^atr^swerdng operi^endTed questions. 

Lowdr numbers on the Likert scale' indicate negative trends; higher. 

numbers, positive trends. Items 4 ,and -open-ended questions, asked 

parents to describe the weaknesses- and s^engths of the EBCE Program. 

^_tems 12 and— also open-ended/ requested parents to desoribe;any ' 

- • • . * ^ 

positive and negative changes in thei> chj^ld'as a result of par;tici- 

- i ' • ♦ • 

pation in the EBCE >rogram\ Items 21 and 22, which were forted' 
choice, askeci for ijerceptions of child*s occupational' plans and plans 
0^t(^r completing high school. Items' 24 and , wl^i^h were openn 
ondc%i questionj^,^ asked parents to indicate how they * first heard'ibout 
KBCK and thoir.Qpinion on the type, of student 'most ^likely t^benefit 
from EBCE. A summary of the results fj^om selected -(^aeBtions Ls'irA 



Table 2-17. . "A* \ ', 

2. Findings ^ ^» ' ' \\ \ \ • • V 

^ ^ * A '; 

.The parents were very positive toward all aspects oAthe EBCE \\'-' 

■ ' ^ ' Vv ■> ^ 

Prograip, part icularly ,on their feeling ^bout their "child ''-^ interest W 

* ' • ' ■ A" \ 

in the EBCE Proqram (Item 3). They wore also'very def initeAtfia t .they 

wpuld again ppnnit their child to-enroll in the EB'CE Prog'i:am J.Item 2). 




■ / 

1r . 



Table. 2- 17 
ion SiitVey 



Parent Opini 

(n=28) 



HOW well does the Career Education 
Program compare overall with the 
> past GchoDl exixjrience of your 
daughter or son? 



2. If you hud it to do over ao^iln, 

would you want yout^ son or daughter 
to/parl icipate in thc^areer 



Kducat iun nbyi am? 



Hew well do you think your son or 
daughter likes the Career Education 
Program compared with past school 
experiences? 



HaVe you received enough information 
about your son or daughter's progress 
in the Career i:ducation Program? 



n < (xiij).ti 1 son wJth i(«iul.>r •.<1kv>1'' 
nuuli ^>)>^>oi_t UTU t y did t hi* < (>i 
^ Ikfucat i on f'Kxp.nn j.rovjdr y.MU 
^daughti') or i.on lo: }< Mininq .il)t>v»l 
occnipat ions:? . ^ 



8. What effect, if any, has the Career 
Education Program had on helping 
, your son or daughter form career 
plan?:? 



In comparison wiilh , regular scHooIr 
how much opportunity did the 
Career Education Program provide 
your daughter or £;on for general 
learning? 




Frequency by Item dioice 



Huch 
Worse 



Definitely 
NO 



' Much 
Worse 



Much - 
Better 

16 



^Definitely 
Yes- 

2 24 



Much 
Better 



1 '^^^ 23 



Definite ly 
No 



Much 
Less 



About the 
Same 



Definitely 
Yes 

7 14 



Much 
Morft 

24 



Definitely ,No Definitely 
Bad • Effect Good 



13 



' Mucli 
Loss 



About the 
Same 



Much 
More 

8 11 



Mean 



4.39 



4.75 



^.79 



4.18 



4.75 



4«14 



4.07 



Stfuidard^ 
Deviation 



SD 



0.83 



0.70 



0.50 



0.98 



0.80 



0*93 



a* 86 



V ^Tabae 2-17 



(Continued) 



r 



Frequehcy\i^ Item Choice \ 



3 



Mean 



Standard 
Deviation 



SD 



10. In co!«p€*iriJ>on with past cxpcripnccs 

* in regular ' i.dioo Is ho?>- iiK>bivaLcd , 

is your dauylUor of son Lo Icani 

in Uic Career KducatJon Piogtam? 



t 11. How woolJ you rate the- approadics 
to lenrnintj used in Uic Cnrecr 
Educnlioi) Pjfo^jram? * 



14. How often does your son .dx daughter 
talk to you about what's"*goifig on 
in the 'Career Education l^royrojnV 



15. About how often have had ciny 
' 'contact 'with any Career Education 
Program* staff members?,* 



16. HoWi nAny* nee tings have [yuu attended 
during this school yea4 where ot fie r 
parents of Career Education students 
^'were pre'jont? * 



17. llo%» vcjuld :^ovi rote tho gencrol 
quality of Lhu Career Education 
Program Btntf/ \ 



18.. Ifow w6uld you rate ijusiness *and * 
coromufiity rosourc(^s*, available in the^ 
Career fducation^ Program? 



10. >((^ would you rat-e your overall 
rej.aLic)yr.hip^ with the stall of 
the C.ireer fulucation J'j5<.^j 



20.. How would you, rote* thq entliusiaem' 
• of the Career Kduca^ioti Program 
staff? , • C ; . 



ERIC 



\ 



Much 
Less 

I 



Poor 

0 



Almosf 
Never 



Alnost 
Never 



None 1 
8 a4 

Poor 

0 0 

Poor 

0 1 

Pooc 

: I 

Poor I 



Abo^t the 
^aiQC 



MucK 
More 



14 



4.39 



' 0-69' 



Excellent 
/ 5 ' 9 14 



Alnost 
Daily 



4.32 



, 5 



17 



Very 
Frequently 



3 4 or more 
0 1 



4.39 



2.46 



1.00 



Excellent 
7 13 

- Bxcollent ^ 
5 13 

% 

Excellent ' 
5 8 



8'; 12 



4.43 



4.11 



3.56 



4.16. 



0.11 



0.92 



1.20^ 



0.90. 



0.73 



0.97 



1.33 



a. 07 




Tdblp 2-17 (Continued) 



ST^^Below arc li.>Lc«l spmc an>i»s of , possible importance for a r.tudcnt to learn. Please late each in 
tGXWb of Jjow ]mj'Ork.\nl ^^ou f i cl it; is for a student to leain, and how we ll you feel t -ic program 
iS acaojnpj 5*1 h iiKj e^ch. ^ ♦ 



r 



How -importcmL Do Yf>u 
Fc^^l Thi^I>arrti r>n Is? 



Frequency 



^Jot Highly 
Important important 
12 3 4 5 V, 



1 . 0 



1 (> 



Students learn to: 

a. Perform spcci f J c 
,bccupaHonal 

^ \^ W' puiulfi;.*! and 
Oigiun t hi ' r 
time. 

c. Arsuiiu* It' pv>n 
ibiliLy foi 
themse 1 vei. . 

d. 'Make decisions 

and follow 
through. 

e. Communicate 
^ith others 
in a mature 
way, 

^ 

f. Be aware of 
more career 
opportuni t ici> , 

g. Wotk with" 
oHjcrs . 

h. * I v.ilnai (' t In I ) 
* Own wt)i k . 

J . PtT ftwin till . 1 1 

academic <.ki 11h. 

j. ThirtK Uii omjh 
and solve 
pi obi cms/ 

K. -Huvr n po'' j 1. 1 vv' 
flttitudo U>w<'^rd 
self. j 

/ - ' ^ f . . ■ ■ 

J/ Have a pOM^tivc 0 0! { 1 4/ 22 4.:78 
^ flCtltude ^6w<\rd-. ? 
work. 

m. H»ivo t<^ po^ i Li vt'i 
« t L \Xx\ do t tr^ a rtf 
, l'e^^rn i ng . / 
. > 

4 

• / 

o. Improve 'iuLor** 
person al ainl ^ / 
soclaJ -ftkiOsf / 

• f • • • ♦ ' ■ I ? ' . • ' 1 



' n^ rropnic foi 

fuitluM rdur.jlio0 



0 0 3 23 



0 0 0- -3 24 



0 0 3 * 5. 19 



0 0 Ot 0 21 



0 0 7 1 H 



0 0 i 1 3 23 



0 0!^ 5 ,71 



0 p ! 1 ' 7 ,10 



0 ,0J. 1 ' ,(! 20 



f'.ean 



4.. 57 

'1.74 
. 4.03 

r- 

.'4.81 
*) 

«»- 

4i.89 

( 

' 4 .i59 



4 4fel 



Standard 
Deviation' 



SD 



4.*fc7 
• * « 

4.ff} 



1.04 



0.G6 



0.27 



0,48 



0.32 



0.69 



0.42 



0.69 



0.64 



0.4B 



0.40 



.51 



0.55 



0.55 



0.54. 
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How IMfeclivu iKi You i<i I tihi.* Project 
Has Boffjk^n Acromol ishmg T]nf; Lparninq"^ 



^ Frequency 



Ndt Highly 
Effective Effective 
1 2 '3 4 5 



1' 



/ 



,0 5 3 4 14 

0 2 6 9 10 

0 1 8 16 

0 2 5 6* 14 

0 0 ^ 12 13 

1 0 4 6 16 

0 0 3 4 19 

J 2 6 7 10 

0- 1 7 : 1 ,33 

i 

0 2 7^ A 13 

i 

0 0 ''3?" 8 14 

r 



3 




6 




it 




















8 


> 


















1 




8 








0 




11 









Moan 



-4.04 



^,00 



4.4J 



4. 19 



4.41 



4.33 



4.02 



3.{Ui 



4. 17 



4.0JM 



4.44 



4.27 



4. 12 



3.81 



4.37 



Standard 
Deviation 



'SD 



1.22 



0,00 



0. 89 



1.00 



0.64 



1.00 ' 



0.70 



1.14 



1.01 



1.06 



0.71 



1,04 



1.03 



1.06 



0.69 



\ 

Parents were asked to compart t^ie EBCE Program with the regular 
schools in Items 1, 9,, and XO.on opportunities for their child to 
learn about occupations, opportunities for general lean^'rigi and 

on motivation* to' learn. Parents, responded very favorably .to tfie 

\ ' ' ' ' ' - ^ 

EBCE Program oh al^ three aspects. They v'ere most positive on the 
opportunities to learn |bout occupations and least positive on the 
^ opportunities for general learning. 

I^arents indicated'* they had very little contact with EBCE* staff 

during the school year. The response to Item 15 indicated very few 

'ft- ' * ' 

meetings with stpiff memlpers. The mean response on a scale of 1 
(almost never) to 5. (very frequently) was 2.46. The parents indi- 
cated in Item 16 that they had attended an average of one meeting 
witli qther pa^j^ts-during the school year. 
^ .Parents were asked to rate the importewice of a selected number 

. of goals (Item 23), The , parents rated all of the goal6 highly 
important. o They rated the goal, "to perform specific occupational 

skills," as the leairt important goal. They rated the goal, "assume 

^ ■ < ■ 

^, , rosponsibili ty ,foi? themseiyes , "^as the most important. Barents were 

,3i^so asked -to rate thp effiectiycMiess of the EBCE Program on each of* 

^ tshe goals. They gave the EBCE PrograW high marks on the effective- 

nessiof accomplis,hing the g&iLs. Pairents rated ^ the EBCE Program 
' , '""^ - f ? ^" ' * 

mtost effective in. agcomplis^jring the following goals: work 'with others, 

- pagitive attitude toward self,, communl^^tin^g *in a mature way,, and in 

^ as^uming'xesponsibility for ^themselves;' Par^^ts rated the EBCE .program 

^\ *• ^ . ^ 'j ' 

. as -J^ast* effective on the goal, "prepafe^' for: further education." 
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Parents were asked to identify the ma jor , weaknesses of the EBCE 

Program, The number ^of job sites available a nljl^thp^ limited depth 

of experience available at the ^ob site were cited cts the major weak- 

nesses. Communication between, staff and stucfents or staff and parents 

was listed three tim^ as^ a major weakness.' T;:ansportation and the ^ 

.depth of the course work were each citec^ twic^ as major weaknesses. 

/ 

IMrcnt^L? li*;tcd the following concci^t-; as being the greatest 
stronqthr, of the f^rotjram : chance tc explore various careers, chance 
to m(>et and interact wit^ many different {)coiUc of the real world, 
change from the traditional school classroo^; and interpersonal 
development. . , ^ ' 

Attitudes of Participating Employers Toward ^BCE at Mid-Year 1973-74 

i. Administration *and Description of Questionnaire 

Program records were* examined' to identify 'whibh of the 102 EBCE 
experience sites had received stydent placomonts 'during the first ' 
j;eme;;ti^r of tlu> 1973-74 schooJ year. A tpt^i 1 of 53 sites were identi- , 

« * 

rie(i. One of Uu^ experi(^nce sites had .riotif i'ed KHC^i ,st:aff that they 
would bo glad to ooofierate as a site but that . they 'would not respond 
to' requests for evaluation. Therefore, 52 contact 'persons were s'ent 



a form letter indicating the need for ev'aliuative data and requesting 
that they give a questionnaire ifo each of the employees who .haii wt^rked 
directly^ wi*th EBCE students during the school year 197:^r-74 fsee Appendix 
A-4). Sixteen different ?itos had returned the cotnpleted questionnaire 
by March 4, 1974.' 'a totdl of 33 resource person responses were 
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Table ,2-18 

Responses from Eii5)loyer Questionnaire 
tn=33) 

1, Number of hours typically (^nt with students* 



range - 1 hour - 35 hours per week 
^ mean - ' 14.38 hours per week 

2, Types of service, provided to students (frequency by service) ♦ 



a. Talk about job opportunities 

b. Tadk about students* personal problems 

c. talk about activities at your site 

d. Tutor in academic area 

e. Evaluate individual student's assignment 

f. Assist student in non-job related assignment 

g. , ^Supe^vise students on specific job-related task 

h. Help plan student assignments . , - ^ 

4, How did you become involved with CEP? ' - 



Yes 
32 
20 
30 
16 
22 



25 



No 

13 
2 
17 
11 



19 14 
29 4 



8 



19 EBCE 'personn'el contacted me.* 
7 A student talked to me. 
1 Another employer talked to me. 



12 Company personnel talked to me. 
'6.- Did CEP staff provide you with enough information to help direct studer 
25 Yes 

^ 6 No * . . 



Would you .recommend to another person that he/she also become in'^^blved with 
CEl»i* * ^ ' 



30 Yes . 



1 ' No 



ERLC 



a. .Quality of work performed 
»by regular employees 

b. Amount of work performed 
by regular employees 

ci\, ,/<!6mpany hiring practices 



an impact on you^ifite? 




/ 




How Much Impact / 


Value 


of Impact 




^ i ' ^ •'Don't 
None Some ' ' \ Much Know 


Good 


ly^^ Don * t 
Bad Know 




14 i3. '. 2 ' 1 ■ 


,{ 


, 0 6 




12. 12 5 2'; 


'13 


2 6 




19 2 2 . 5 - 
15 • 7 '" 5 ^ -4 ! . 


' 5 ^ 


0 8 
0. 7 



^ ' Table 2-18 (Continued) 

10. Do you think the CEP students; are interested in your site? 



Frequency 








> 


Definitely 

NO \y 

1 A 2 


Definite^ 
Yes 

4*v 5 


Mean 






^ ^/A / 5 • 12 \ 


6 6 


3.03^ 


1.23 1 





11. Do you think the /CEP students are inter^ested in the CEP? 



Efefi^i,.teiy_ 


r 

r 




Definitely 












Yes 








2 


3 ■■ .,' 4 


5 


Mean 




0 ' . 

"1 ^ «~ 


4- 


■f" 12 


9 


3,81 





12. How Iiave employees- at youir sit^/ reacted the CE;p? 



14 Positive*^ reaction 
0 Negative reaction' 



i / 



15 .Mixed reaction 
0 No reaction" 



0 Not applicable' ' , 

1 Don't know 



0: 



';// 



13. 



In what ways have employees benefited? 

3 They haven't benefited, . 
17 Increeised their awareness of youth. 
5 Motivated them to further training. 



7 Reduced their workload. 
9 Increased interest in their own work^ 
3 I don't know.- ^ ^ 



14. Do you receive adequate feedback about whAfc-happens to the students? 





Frequency 






Never 




Always 




jl ^. '2 


' 3:4 




Mean SD 


is 5 


5 ' 2 


0 


1.78" ,0.99 



15, 



Do you receive/ ad^uate feedback about the effectiveness of your work with 
the students? 

Frequency r 



'A^' A. y.:^ • 



"tlJever 



^ 3 * 



? ' ^ Always 

4 



. ^ I^.^^^'plan v^j^oj^^ Qie CEP?] 

/ ' ' ' r./-^ ^ . ^(^ e ' ^mi ^ .Xl Doii^'t^ Know"' 



Mean-^^. ' SD 



» . T«bl« 2-18 (Continued) ^ 

* -*j * • 

23. Belov arc listed some ai>eas of possible importance for a student to learn* Please rate each in 
terms of how important jrou feel it is for a student to learn, and how well you feel the proqr&jn 
is.^accomplishing each. ' 



^ot , Hiqhly 
impoL t an t Important 
1 2 3 4 5 



Students learn to: 

a. Perform specific 
occupational 
skills 

b. Be punct^ual and 
^ organize their 

tijne 

• c. Assume respons- 
ibility for 
themselves 

d* Make decisions 
and follow 
through 

'^e. Owtomnicaie 
with others 
in a matuLc* 
way 

f , Be *w«ire of 
more .career 
opportunities 

g. Ifork with - 
others 

h'. Evaluate their ' 
own work- 

i. Perform basic 
academic skills 

j* Think through 
/ and solve 
/ problems 

, k. Ha.ve a positive 
attitude toward 
•elf - 

^ 1/ Have a positive 
< attitude toward 
^ * work 

m. Have a positive 
attitude toyard 
learning 

n* Prepare for ' 
4 further educatior 

o. I strove inter-* 
personal fnd ' 
social sKllle 



How Importtint Do Vou 
Fool Thin" licnrning Is? 



P'rcquoncy 



1 4 5 7 14 

0 0 3 7 21- 

0^ 0 *2 8 23 

0 0 6 19 

0 0 1 12 19 

0 0 5 7 20 

0 0 2 9 21 

D 0 • 6 8 ^15 

0 1 5 10 15 

0 0 6 1 19 

0 0 3 7 22 

0 : 0 2^ 5 25- 

0 ;t 1,4 27 

.1 0* V 5 23 

lo^' d 3; IB 



Kean 



»3.94 



4.58 



4.64 



4.41 



4.56 



4.47 



4.59 



,4.31 



4.26 



4.41 



4.59 



4.7a 



4.WL 



4.53 



4.47 



Sta]!tdard 
Deviation 



" How Bffective Do You Feel the Project 
Has Been in Accomplishing This ly*ffrninq ? 



SD 



1.19 
' O.fe 
6.59 
0.78 
0.56 

0*75 

I 

0.61 

o;79' 
q»85 

0,78 
0.65 
0.57 ^ 
0.46 . 

0;90. 

0^66 
69 



Frequency 



Not Highly 
kffectivo ' Effective 
1 2 3 4 5 



1 2 /l5 4 6 

^ i\ 9 5 

1 4 8 9 7 

2 3 15 5 4 
1 3 lir 7 7 

1 0 10 8 

2 a 10 8 9 

1 4 15 3^:4 

2 1 14 5 5 
1 3 15 T 3 

1 '2 14 7 5 . 

1 .6 8 6 7 

1 4 12' 4 8 

2 2 9 6 8 ^ 

1 2 10 12 3,-. 
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ftean 



3.43, 



3.48 



3.59 



3.21 



3^55 



3.90 



<5.76 



3.19 



3.37 



3.28 



3.45 



3.43 



3.48 



3.59 



3*50 



Standard 
Deviation 



SD 



1.02 
1.00 
1 . 10 
1.03 
1.07 

4 

0.99 

'lao - 

0.90' 
1.06 . 

^o.sri/' 
' 0.97 

1.18 * 

1.13 

1.1? - 
0,^1 S'^. 



received.' One* other experience site pontact person called to say that 
a student, had been placed, but-'he did not know who the /Resource per- 
son had been. . - C • 

i . . . 

A 

The Employer Questionnaire attempts to determine employers* per-- 
ceptions toward various aspects 'of the fEBCE Program; ,Tfie iquestion- ^ 
naire, in addition jto a series of , background information questions, ' 

. ^ ,/ ' - ^ . /. * 

Contains- ^1 qu^tions. Some are -^en-ended, some>are forced choice, 
and others aSk for Likert scale responses.^ A stmimary of the results 
on selected questions is presented in Table 2-X8. 



2, Findings , / ' 

' ' ^'-^ /I ' ^ - 
. Respond(^nt^/w©te ger>eraH^y^ positive to^ the EBCE Program. One? 

/ \ * ^ 1' ■ ; I 

indi(fi^or of the' degre'e^ of suppiort can be ^ound in the responses to 
Item 7 of the questi'brinaire*. Resource perfons overwhelmingi.y stated 
that they would recommendVlnvolveraent with|EBCE to^ another person. 



Another indicator -is provided t)V th^' data Srom item 18, "Do you pl^ 
to continue participating- 'in. theN qEP?'\ Tv4nty of the respondents 
indicated yes ; the remaining 13. respondent^ didn't know. ItAs possi- 
ble that th^se '13 were' employees who feel-'^hat they could not make 



this decision* ^ ' . " - ^r^^ ' ^ ' 

< ^: r -^^ I 

'Empjoyers indicated that they ^pent'r4|38 hours per week on the 
aver.age wOytkirtg' with stddents. Tjie employers provided all of ttie 
listed '^setvices (item^^) to the students but primarily mentioned job 
opportunitlv^ , activities at their site, arid sup^srvision of students 
on specific j'ob-r elated * tasks. ' " 



More than Tone half of . the respondents indicated that they became 
involved with EBCE as a result of contacts from EEICE personnel (Item 
4), A large, number of respondents indicated they became involved 
with EBCE as a result of company personnel. 

Communications' between EBCE personnel and employers may be a ^ 
weakness. Responses to Item 14 indicated there was very little feed- 
back about what happens to students after they leave the site and' about 
the effectiveness of employers' work with students. On a question 
designed to determine the sufficiency of information received to help- 
direct students (Item 6), most employers indicated that the informa- 
tion was sufficient. The six who responded negatively to the quest^ion,- 
however, indicated any ^information would help. 

.Respondents were* asked about the impact of thQ students or the pro- 
gram on the resource site items 9, 12, and 13, There were indica- 
tions that the program had |)rovided some positive impact on the exper- 
ieafice sites. Respondents particularly indicated positive impact, on 
,<^he amount and the quality of work performed by regular employees. 

Regular employees also benefited in incV^aain^ t^i.^ .awareness of youth, 
increasing interest in tl^eir own work, alfr4,«decreasiog the'ir ivorkload. 

Employers .perceived that students 'wer^/j^i^l^^ 
disinterested in their sites (Item 10). HtnsPpye^iij*Jthey indicaLteii that 
the students were interested in the EBCE Program (5t;e%/ll) , 

' Employers were asked in Item '17 to rate the impor^i^ifice ^f selected 
' ^tudent goals. Tho respondents rated all goals as imp6J,tant. Goals 
ranked the highest wore to have a pofitive attitude towair^f'learning, 

/ 

/' ■ 



to hav^a positive attitude toward work, and to assume responsibility 
for themselves. Goals ranked lowest were to evaluate their own work 
and to perform specific occupational sk>i?Ils, The employers were also 
requested t:o rate the effectiveness of the EBCE Program in meeting 
these objectives. Although the employers responded positively, they 
were not as positive as the students and 'parents in judging t^e 
effectiveness of the EBCE Program, They indicate^d the program was 
most effective in, making students aware of career opportunities and 
working with others; it was perceived as least effective in having 
the students^ evaluate their own work, make d^cisaohs and follow through, 
. and in thinking through and solving problems. 

Respondents were asked to ^identify the greatest strengths and 
-J ; weaknesses of the EBCE Program. The; primary s^x^gth was that the 

•1/ ^ ; 

^ KBCE Program is a viable alternative to the traditional educational 

' * e 

programs. Lack of communications between EBCE staff and employers j^^as 

cited as the major weakness. 

* it' 
E. Summary of Kindings 

Data wore gathefcrod at mid-year froin.FY 7 3 EBCE graduates, FY 74 stu- 
dents, FBCr: parents, and from cooperating" employers . Datia- on attitude 

^ f • / ' ' 

of students, parents, ^and oinployers^ toward the FBCE Program were emphasized. 



The KBCE graduates from FY,/73 were very positive toward the EBCE Pro- 
gram. Most of the graduates indicated they had very little difficulty 
getting work and none reported difficulty in getting into college. Most 
of tlio qraduat^on reported that their EBCE experience had been ^eneficial. 
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The FY 74 students were very positive toward f the EBCE Program. The 
positive react ions vC^n^e generalized to all aspects of the EBCE program ^ 
with the possible e;fception of the lack of feedback received ^from employ- 
ers and staff relative to the students' performance. 

Parents were ver^ positive toward all aspects of the EBCE Prografn. 
Tj^ey were not quite aa,^ satisfied with the communications they fiad received 
from the EBCE staff. 

Employers ten^d to be positive toward the EBCE Program. They were 
particularly positive toward the ^concept of the program. The resource 
people indicated a lack of communication with EBCE staff on what happens' 
to students or the effectiveness of their work with students. 

VII. STATUS OF EVIDENCE CONCERNING EVALUATION HYPOTHESES AT MID- YEAR 

None of ^the^fteen hypothesea listed in part IV of this ^section can 
be accepted or/ rejected at this time. : It seems relevant and important/ 
however, to present the status of evidence currently available concerning 



thenc hypO/Chosos. 

A. Ilypothoses Concerning rmpact ^n Student ^Behavior 

No cor\clusion of program impact on student behavior .can be drawn prior 
to completion of plans'in the summative evaluation design, which requir 



post-testing of EBCE students, the Cooperative Work Expe|?ience>tudent 



sample, and the comparison sample of Kanawha County l^th grade students. 
♦ ' ' ' 

Rigorous analyses ot data' will also have to be completed. 

The nine hypotheses which deal w'ith program impact are listed below 
with relevant evidence from the anaj^sis of pre-test^'data. 



> 



1. Hypothesis 1 - EBCE students will become more knowledgeable of 
the world of worH^ thah^ t^le^stt^^ents from either comparison group. 

' There .were no sigfuficant differ^enc^s^^etween^jtHe EBCE students 
and the jcomparisljn ^^snips^^orTthe pre-test of Part 2 pf the Career 
Maturity Inventory' (Knowing About Jobs). - • ^ 



2^ Hypothesis 2|V EBCE/students will be mor^ capable of IpcatlCng* 
and Acquiring woirk than the students from either comparison gfoup. 

if ' » 

This ^hypothe^is cannot be adeqilStely assessed until the sum- 

% ^ 

mary of 1974. '^^^^^ are no, comparison data available at this time'. 
A review of the progress of the bX73 graduates indicates that most 
of the graduatesf3?ad no^ difficulty getting jobs. EJight of 18 . 
respondents had f^ver been turned/down for a job. ' * " , - 



3. Hypothesis EBCE students will do a^well as- the comparison 



yroaips. on scholasjbic growth. 

7 f ' ' :^ J' 

There are no^;i?ost-test comparison data available at. this time. 
Ahalysis of the Educational Development Series pre-test data indi- 

■ - ^ ^ 

cftlt>;-» that th(>r(>|wci': a s ignif icant^differonce only. on. l:fir i;nqlish 

\ I ■ • ? 

scalcA amony tho ^»rot> <jroups . Thik di Cforcnce"^<is.«not idqnt.if iod 

' V ' ■ ^ . ' " '. " ~ ■ • I ' 

when the ^chef f^^.test was utilized..''"'"' ; <^ ^ , ■ 



^4. Fiypothej.U's\46|- gBCE" studejits wirll be more positive *in th&if 
atMtude toward ^lie vorld of work than the students from either 
^comparison groupTf ^ ' . 



The COOP students scored signif* i,cantly higher than t'he EBCE st'u- 



dents, on the* f)re-te§t of the Attitude' ^cale.of. the Career Maturity 

. \ 

Invent-ory. There are no mid-year. comparison data avajtlabll..' 
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5. Hypothesis 5 - EBCE students will be more capable of plani^ing 
for .their future than the students from either comparison gi^p. 
The COOP students scored significantly higher thkn\the ^BCE ^ 




students on the pre-test of Part 4 of the ^Career Maturity Inventory 

(Looking Ahead). There are no mid-year 'data available from the- 

^> • - ' * 

cojnparison groups*. ^ ^ ' ' 

' • ' \ 

6* Hypothesis 6 - EBCE students will be more capable of solving 

the problems confronting tKem in reaching their goals than the 

students from either comparison gjroup. 

A review of the scores on Part ^5*~of the\:areer Maturity Inven- 
V). ' . ^ ' • , ^ ^ . 

tory (What^ Should They. Do) indicated a signficant* difference 'among 

the three groups. Thi^ difference was not identified when the * 

• •# 

Scheffe' test was utilized.. There are no mid-year data 'available 
* from the cpmparisore groups. = ' , ' ' 

7. Hypothesis 7 - EBCE .students wilj. become more capable of 
^ ap(,>1:-aL.sing ' the caftidr-rc] eVant capabilities of others*J:han the ^ 
stud^Tnts from cit^fier comparison group'. ' - » - 

■ ■■' ' ' ^ - / 

There was no significant difference between the EBCE students 
and either, comparison group on* the pre-test of Part 1 of the Career 
Maturity ^^liiventoty (Knowing Yourself), There are no mid-year 
available from the comparison g'foups. ^ ir 

8- . I|ypothesis 8 - EBCE students wiil-^be more a^le to choose* real - 
istTc career ^oals than the* s'tudents from either comparison group. 
The random sample jaf 12th cfrade .students scored significantly^ 
^higher on the pre-test of Part 3 of the Career Maturity Inventory 



■\ • ■ - . ■ ■ 

(Choosing a' Job) than the EBCE students. .There wer%* no mid-year 

data , available from the conjparison groups. ^ 

-/ ^^^^ 

9. Hypothesis 15 - Were ji^iill be a lower relative frequency of 

school 'dropQuts frbm^the EBCE project .than from the Kanawha 
7/ ' ■ ^ 

' V County Schools. * . ^ 

No data 'hav6 at ^this dime been received on this variable. 
* ' / * 

B. Hypotheses Concerning Attitudes Toward the EBCE Program 

Tentative /conclusions can be draym concerning the attitudes of certain 
;key, groups^ toward the EBCE.-.]^rograin; Parents, participating employer con- 
t)^ctesand/re source poeple, fall entrants, andU^73 -EBCE graduates have . 
expJ:fe^ed"positiv,e opinions dbout the prog^ram a*ifirit^\ effects on student 



beh^Tbr, Non-questionnai>^;e data from lab9i;"ainie)rfe>v?ugg^.st positive 



attitudes. Whilte still incomplete, the available "cjatai qqhstitute evidence 
po'tntin^ toward adcoptance of hypotRi^se^ 9, aO^^Xl, aitd^2, which are 
'1r«te4^beloV. >^th supporting evidence. 



•1:. Hypothe^f^sgc^.BSiC^ p^trents will have^ a po\itive>attitude 

toward the EBCE Ptbgri^m. >*s^^>.--^i. Z/"^' r , \ \ / * 

' • • , ' ^ ' ^ / V // 

A review of the ^fe^from the &aftin^ Opinion Suryey adm^nij- ^ ^ t ^ '/^ 

. tared at mid-year indicated that thfe parents 'were. VeYy positive- / J-' 
toward the EBCE Program, . - . * 



2. HypQthesis 10-- VariouV levels- of employers -(ie, rosouixi^/'.'^ " T^- ^/^'-''^ 
persons,, contact ^porsJns, and. managers) vAll have a Pj^S^bti^e ^at:tir /.''^ djT" ' 



tude' towarS* the Eft&E Program-v^v 



'J /: 
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, -as 



. : -:.'.;A'i:€^vi6tt:fOf 'the data^frbm the Employed Questionnaire, adminis- 
tered at mid.'^year, indicated thajt the employer resource people have 
•a positive attitude toward the BBCJE Program. 

3. Hypothesis 1^ -r'EBCE students will have a po^i^ive attitude 

. • . './ • * :-■'.•! . •• ■ / 

toward/the EBCEV pr^ram. / / 

' ' / / 7 ' ' 7 ^ 

K review o'f .tiie data from the Student/ Opinion Survey',' adminis- 

/- - ■/; ^ ' / ' _ 

*tej/ed at mirf'-y'^ar, indicated that the students 'are very • positive '/ 

,ia thfeir attitude toward the EBCE Program. A review of the data' 

from the EBCE Graduate Questionnaire, administered a4: mid-year, 

^ indicat^'d that the 1973 EBCE gradfiate3 ar^ very positive in their 

'/ ^ % 

.attitude toward, the EBCE Program. ' 

'.4. Hypothesis 12^'- LcUbor union officials will have a -positive 
*. /attitude- toy^d thj^' festE Program. * - 

/'There/are 'ij^dicatio\s that many labor union officials have 5 

pos^i^ve at;fitude toward the' EBCE Program. , Thirty-six labor unions 

' ^i// - ^ ' . ' ' - ^ \ ' • ^. ' ^ ^ 

.wprk d^^ctly >?ith the EBCE Program. Two laBor union officials are 

, ; active In ►the EBCE^ Community Advisory Cguncil". 

C. Hypotheses' Concerning "ferogram Endorsement % 

The EBCE Program is, operating in- K^inwawha Couirf:y> .West Virginia, .for, 



Jthe current school year" (1976-74) wdjth the ..endorsement of the Bbard of^ 
J* • - f * 



Education of Xanawha County an<} ,fc^^|||uperintendentS Dr. Kenneth Unde'rvjood. 
tn addition, the prpgfam operates -ij^lth the endorsement of the-West Virginia 
State-. Department of Education. "^The statuS of hypotheses concerning program 



endorsement "for 1974-75 are listed below with appropriate "I tatements of 
evidence. ^ * 

i X . 

. 1. Hypothesis 13 - Kanawha County schools will »^ndorse the EBCE 
. Program for the 1974-75 school year. 
W -No official endorsement by the Kanawha County schools has been 
received at this time. Kanawha County School Board members' and 
. officers', and high 'school principals, counselor.?, anrf teachers °, 
T cooperate nt many le^ls of program operation, ,,laMinq, and policy 



determination. 



2. Hypothesis 14 - West Virginia Statft Q.9partfaent of Education 
officials .vd-ll^-^Si^e the EBCE Program. ' " * 

^ No official endorsement of state Department .of Education officials 
has been received at fcfiis time. Officials are cooperative and actively 
Serve on 'the EBCE Community Advisory Council.' . >^ 
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SECTION 3 
Interim Report of 

■ 

Experience Based Ceureer Education 
Formative Evaltiation 

March 1, 1974 



I 



INTRODUCTK^ 



''•"Evaluation is the .pfpcess^^irf^ delineating, (ib taming, an^ pro^id- ' 



ing information for judging decision alternatives./'^ Ji major component 
of evaluation is now cOminonlV called formative evaluation, * which is the 



assessment of the value ^df pragreun components^ to ii^sure th'dt, every. ' . 

component works^as well as possible, both in 'isolation and as it meshesr 

" >, >' ^> 

wi toother componen.ts. It' is a profcess which seeks information to* 
answer tWe question, "Is this the bes^t way we' know. i:o ^do this?" * 

♦'in cori^iticring the various ' compprtents of a p:^o*grcim, the essential 
fbrmative avaj-uatibn questions are these: /Is i€' rtecessary? HoW good 
is ^t?' How c^^iit be., inoproved? ^ ' • 1 . . vf-> 

The process o^ ftfm^tive evaluation,^ cari!I>b^gin >«Lth anc analysis of 
program sys}:ems^hich wiir^identi'fy cri^fc^ical. eomppndnts , f or which - , '^^^ ' 



formative evaluation is' essential (or at least desirable). On the' ^ / 



other^^hand, if is impossible to ,sp6oify.,in adyanoe all px^ problems ' ^'-"/^ 
whj^)i will arise in implementing d^ptogram: '^le^^bi'lity "is 'ess^enlbi"^! . ^ 
for rnrr^inq Out tho troubl e-shootiij^f effc^rt?^ in fojnnati'Ve cvaluatipn.-^'^ 



ir (!)n.(^ f(>cus5^s on tlio AE.L/^BCE Program as^^ rjribr-ni^ io^^r^^ivo^ scW 
vices to students, one can proceed to analyze the progr^nC«"5lit terms^i>fX^, 
a set of interrelated subsystems necessary, to provide jbhose ^rViCes^i^ ^ ^ 

Such an analysis, serves to .highlight the critical aspects ^pf" t^\^9r 



gram, leading to the establishment of* priorities fot formative •evadua^ ^§ 



tion* 'Fron^^this analysis, arises a set <^ information needsl Specification 

— '■ — ^ ~ ' ^ I ■ ? 

. • 5 Daniel L. Stuff lebeam, et al, Edudational Evaluation and Decision 
Making , Ithaca, IllinoLs: 'K'e. Peacock PubMsher; Inc., l!&<71. 

. ' ' , - '> h V • ■ 



' { of tRese needs, in turn/ suggests the kinds of information gathering * 

activities v/hich^must be established. , *> ' . * . ■ ' r 

^ ^ Results of formative ^evaluation of tha^AEL/EBCE Program have "been 

Resigned to have an impact on the audiences served, the timelines 

information, and program decision-makino. The first sources tiiat me 

formative -evaluation reports addressed were the audier\ces served:- the e** 

pro^^ct director, program developers, and operational m^an^^rs. In ' , ' 
* ' ' ^ - / ' 

^ order to 'serve these audiences effectively, the i'nformation was provided' ^ 
early enough (timelines) to affect program operations before revision/' 
^recycling occurred. - ^ v 4 

Fo'^rmatiVe^ evaluation of the AEL/EBCE Program has >een designed to 
affect ptergram decision-making* Most of the formative ^evaluation reports 

' y ^ ' ' , \ ' ' ' 

were 'presented to the Project Director and the Director of Stabilization. 




./^'^ach report was then forwarded to the ajJpropriate persons. 



II. ORGANIZATION 



This section of the report is organized to provide a logical 
development of reporting of AEL/EBCE formative evaluation. Part III 
deals with the design of the* Formative Evaluation Plan . Part IV dis- 
cusses instrumentation and testing procedures. Part V covers the / 

- ■ ■ . ■ ' \ ^ ^ . 

student populations used in the formative evaluation. Part VI identi- 

irfm. 



fiesand overviews e&ch component of the AEL/EBCE Progi 



The 



internal process and the interdependence* of each subsystim are 'descrit^ 
immediately after the overviews. .Part VII presents ,the formative ^ ' 
evaluation findings for each subsystem with major emphasis directed 



\ 



.:er!c 
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toward the ^questions outlined' In the Fomati$«e* Evaluation Plan,^'Con- 

elusions r recommendations^ an^, action taken to -da te""- by the staff aire I" 

" ' ^ . ' - 

included.' Part VII3; presehts a discussion- of- the-sCareer Maturity 

" ' \ ' ' ' 'I I- ■ 

Inv^entory pre-test results which, indicateb^major questions thatv should 



be addressed in the fbrmative .^al,ua€ion. 



III. DESIGN pp. FORJjlATIVE EVALUATION^-''' 4 



The design for formative, evaluation .of the^AEL/EBCE Progranj be- 
tween December L ,and Jaauary 31, 1973 Cjarr^be found in the rormative . 

4 




gvaluajziorty Plan , - submitted to NIE on November 1"; 1973. All ^juestion&'T; *, ' .'. 
'^^ xe/latfng to formative evaluation desigr^ can be answered by, fe^ferrin^ ^, V 



i to this document. 



2.. -'.^ / IV,/. INSTRUMENTATION ^/^D TESTING: PRCK::EDtrRB5&; > " . ^ ' ^'^ - K* * - 

V ^ , Each'in^4«'urnehtVused i^^,,AEI//EBOE's for|35|ijk^fe*!«;^^aluatioA ^v^"^ - 
sheet cbntainlng th^ fQj.lowiag infapnation: • instrlimfe^ ■ " 

, format, aiuJ^jectS' arld i^nfe^^ - f ' z^^^' 

validity t^sts neede^d^^ axid^fr^-^ key tg^guestiortsL 'fe^tJit^xnedr^ ""^ " " 



tive Evaluation Pt^n* 



this dpcumeri€.- Qu^feorts a|)oxi^instrV^^^gt^on / J/ 
Should .be,>referr&d" 'to "l^e -appropriate cov^er '%\ve^S&. cyf "^ky^^e^^^sKt^ : - 



V,- STUDENT POPULATIONS' ^ 



The -student ^ampl^' 'for *the -AEL/*EBeEr Program w^s dtawn frotn^feenior^i^ ^ - .ys^i' . :* 
in the Kanawha , County School System Vho voluntqer^ the p^^g^a*!}. ^^ ..^^ . ^ 



SI 



This group is the same as the experimental groiup-deg'ciribed in part V * J- / 
of Section 2 on Summative Evaluatiqn in'.this <3pci:unent.' JU'i .questions * 
about* studentiipopulation^ -for formative eyaluat:ioa"-s'h0a^ : 



_ • > 



by referring to the section cited above.- ' ' ''^ , 



VI. OVERVIEW OF.AEL/BBCE ^gDQy^.^^^^^^^ ' ' , / 



A- '/Overviev?'of AEL- Experience-Based ^<e^r . . 

- . - AEL/E^^CE is an altqjTjiatiye, educatiohal program in which volunteer 
• ^ ^ ' sttid^nts engage'- in learning ^periences at places of employment ^nd .^ > 

' other- community site^'^ristead of in tr;aditional cflassirooms. 

' ' " ' * - - ^ * ,^ 

V - student^ >dre..recruit^d'iJ>^S'eptember .ahd'Tn January from high ^bhools 

the 'Karrawha County SclTQoi ^S;^^, Most are 'high school seniors withifaT^^ -^^^ • 
, ' ' . ^ five -credit^. Of gradu%t;i^\ . "I^^^rested *^ta<ienfs and ^ 
' f ' ; 5^"^^^/":?^^^"?^^ p?:«^ram and fo^t^btain 

about ^s^p^ent-Jj^ needs. Program staff evaluated^ 

' ^ - : .J|f^ 'int^re^ts ai^^^^fed&^V^cludtn^^high school traftscripts) 7 those . ' . 

J*ic.r^|^-'^. ^^^r-C^/J.^^^'^*^ ;ftet--tJ>e';5Bj^^ priteria.^^ere notified of. t'heir acceptance.' 
-..y-"'"'' ^v'» = ..,^n\Sei3ternb^r^e^''studeiits' year- big^nJiW.th. i t'eh-da-yf orientation '. ■ 



'''^ .^:.i.^^"P^F^ic>^.*^, ; January., studeiits had> f j^vcj^da^^^ Orienta--^^' 

'" ^X^^^ included an 6verview^..6f^ the; ^content arc&fe/ adraini&t.ra'fc''iort^f.' stan'd-- t 
^ ^"'" '''^^ ardized test's, and^ familiarization wi^' the various resoui-cf^ and pro- \' / ♦ 
: ' W<^pres o^^^^^ cpnclu4lBd wifch. indivictual. ^ ^y'" 

-:,-y^" J?^^^^^^^^ between students' 'an(i le^rrjingr pop fSiai^toVs.^ .\The learning ' ' ' 
.^^.-^i;;-^ provided the direction and r<>scmrcesilfor' 9^^^ stu^ent^- ' ' /. 

Vy- >3* ' * • ' ' ' / . . ,^ " A V/ ' ^ r ' 

' -.r^"'. ' 5feo' develop av personalized ^6t^ of .learning expiiFiehces based oh the ' - 



student's int^test^,"^ '/leeds, and atademic requirements. U^ing the 
t Program - Profile (a .suramaryiof the student As. needs 4n*d itttwest^)*,^/the 
student and learning coordinator prepared a JS^rogram ^^r^afp^^tipJor ' 
for each major program aVea the student \would puriue. At tlris time,' 
activiti^ were, outlined which were ^ijntended tp lead to!;,the achifeve- ^ 
ment of the student^' s goals. ^ " " * .* 



The activities could be compl^t^d\in-house/^u^ ti^ ^instruc- 

. ^ ' ^ 

tional materials and other resources ,of the AEL/EBCE .leanring center, 
or they could be ejcperience 'site-based activl^iefi.. , ? §tu^ents were ' ^ 
placed at sites to do real or simulated work >or €b* qbs^r^e, remaining 
at the sites iintil the planned activitie3 wer^^-^cceiinplished. 



The Progray Area Descriptor constitutes a planV^fdr sev^eral. weeks-^,^- 

wprJr, to be expanded pr modified as s t to ^ t^ ^j^x^^^s^^ r refine ^heir > 

interests. Each of the planned activities^Was del^'^^i^ori^^>n^ Activity 

sheet , ci, document on which are recorded specifii^t^behbvioral objiec^ 

* * ^ '* ' . ' ^ 

a description of the activi1:ies to be performed, ahd-^assessmetUpa, (by > 

student..^jmd learning coordinator) ^of the assignment, -the stu^ept^s ^* 

performance,' and goal achievement. Tl\e«o planned activi^ie^.randr * V 

- * . ' ' ~ ^< ; N-^"Vs 

associated evaluatio|i8 determined and justified tti^ awarding of aca-- 

^ '-, \ ■ • ; 

demic credit required ^or hi^ 'school graduation. ^ " . 



tl^e 



B. Overview of Subsystems 

The preceding briefly described the EBCE system in terms, 
of the delivery of services to, students. Implemehtihg th^ program 
required the smooth and timely functioning of five svibsystems.''V'Fiigure 

^ •• • .vT • 
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SMbsytim 1 

Wentlflcation 

and Recruitment 
of Employers 



1- 



SubsynemJ 

Recruitment and 
Selection of 
,Students 



Employer 

Site 
Analysis 




Subtysttm 4 

Delivery of 
instructional 
Services 
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• 








Support Subsystomi 

a. Instructional Material - 

b. Learning Center ' 
c: T(||^sportation 














Figure 3-1 




^bsy«ems of .the AEL/EBCg System 


* 



portrays these subsystems and their interdependence. The description * 
of the operation of the subsystemg is based on the way they functioned 
between September, 1973 throxigh Jan)i«r7> 1974: They are described in 
the present .tense. Modifications occurring after February 1 wil,l be 
reported in the final evaluation report, - • 

The following acti<?ita^s had to be completed for'^the prog^ajj^to 
function ef fectivij||^: (1) Experience sites, had to be deve'loped; 

(2)^ these -sites had to be analyzed in terms of requireriients , expec- 

» 

tations, ^and opportunities for student learning activities; (3) stu- ' 
dent recruitment and selection* procedures had to be established; and 
(4) : the instructional delivery subsystem had to be operational, (5) 
Additionally, certain^ support subsystems had to be developed, including 
transport action, instructional materials, and various resource docu- 
rngp^r^"^ be used by learning coordinators as they worked with students. 
These support' subsystems are i)ot described because the \[uestions in* 
the Revaluation plan did ^not cover them, ^ 

rhe remainder of. this part ^deacribes"^ the four major' subsystems,^ 



1. Experience Site Identification and Recruitment Sub^yste 



m 



^ Begrause \ significant portion of the instructional activities 
within EBCE occurs at experience ^ites, it is essential that a 
number of sites be .-Available which parallel the interests of stu- 
dents arid the parameters established by AEL, Foarthermore, the 



sites have" to provide meaningful and relevant learnings experiences 
for students. The procedure, for j^rfcaining experience sites is* . 
portrayed, in Piguire 3-2'. ^ . ' 



. Career 
< Clusters 



Inventory 
of Potenti^^ 
Experience Sites 
in Community 



1. Appropriate 
Experience 
Sites 

identified 



Student 
Needs and 
Interests 



4. , 



2:^Experience Site 
Agreement to 
Participate 
Obtained ^ — 



Experience 
Site 

Analysis 

(See Figure 3-3) 



, Fig|jre3-2 

•Employer identification and Recruitment Subsystem 
January, 191i4 



y 



Wheri the AEL/EBCE Program was initiated, we3|J.-*known ^eciple 
v^o were knowledgeable *abput the Charleston^ coinmunj(ty identifiedf 
potential experience sites in order ;t© insur6^^5^Ut all Office 
Education Career Clusters were included, ^pther sites ^ere, and 
continue to be, incorporated in order to meet st^udent needs* 

Once a potential experience site is identified, the^chief 
executive at that site is contacted, £BCE is briefly described,- 
and an appointment is re^ufested if the employer indicates an 

X 4 

intero^t in participating, meeting is arranged at whi^h ' 
material describing the program is presented, questicrhs are 
answered, and the employer is asked to participate. If agree- 
ment to participate is obtained, the^^^fience site analysis 

is underteUcen. ' - P ^ 

^ ir ^ 

At thj^s time, developfhg a new experience site is the join^ 

responsibility of learning coordinators and an Ex^erj^ence Site 

Refcruitment' and Educational 'Utilization Specialist in ^ the Design/- 

\ ^ * 

nov(>lopmp!it tlnlt . * 

• • , - . . ^'^ <^ 

" - . " ^ 

2. ^ Kx})orienco Sitj. Analysis Subsystem. * 

The Experience Site Mialysis Subsystem (See/^i^u^ . 3- J) is 

directly linked to the Experience Sitd Rec»lJitfient/fee lection 

Subsystem. The primary outputs of the Experience ;Site Recruit-. 

ment/Selection Subsystem .are. express-ions of ^a^ willingness/ 

unwillingness by employers to participate i^.the AEL/EBCjE . * 

Program. , . . ' ' . 



/ 
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1 



- \ 



I.OtnainMid 

Analysis 
' Team 



/ 



'2. Forms for. . . , 

/Obtaining ^nd 
; Recordin^Slje' 
- Analysis Data 



a. 



^ Matenals MxiuV 



Exp6r1^nce Sites ^ 



/ - 



i 



•4.^ Interview 

Contact Persons 
andiljBsource 
vPersonsat Site. 



5. Analyze Task 
^' ^•;Statemen{s and 

Generate jSlt^- l ^ -^^ 
j-V. ' r Based/l^rnifig" ; ^/j. 
: /' Activitffei^' J :, " 
' ' ' / - 

— 77-? —i — 




r/ - Prepare. , 

^Learfjhg'GuiHey 
\ for £a'ch, Site > 



-.7 




7.'lhtervrew 
• 'Experience Site 
Representatives ' 
.to Valida^ : ; ^ 



.r" ' y fe^^ea'rniog 



■ Jnjtruptionai 
'ISce Figure 3-4) - , , ' \ •• 



5 



/ ^ / ^xperwnce Site AnalysiS'Subsystancd ^ - ;^ / : a 



The Experience, S 




v. 



Analysis Subsystem has' been developed to 



analyze each site:; Tli^^^ of the experience site analyses 

are Experience Site LeaSftina Guide3_ fpr_,everv experience site, 



:e Experience Site Lea^ina 
T 

These Guides provide information which help .both student/learning 
5pordinator teams and' employers to maximize benefits, part^icularly 
in planning. • - ' ' . 

AS outlined in Figure 3'-3, tl^e.first step in the subsystem i^ 
to obtain and train^a site analysis team. These people can be 
program staff members or consultants. The training of the site 

- . \ \ - 

analysis team revolves around Step 2 - the forms for obtaining 
and recording site analysis data. Befor^ visiting the experience 
site, the analysis team becomes familiar with all material pre- 
viously collected on^ that experience site ^^that questions' can 
be anticipated and answers prepared. The first time' the site 
analysts team visits the 'ej^erience site is at Step 4.- The pur- * 
pose of this ^isit is to intervi-few. both the contact person(s) 
and thft roaourcp person (3). Tho intprvl ews arn designed to obtain 

> 

'the Ifollowing types of information about the experience sites. 
Logistical information - (1) Is there adequate ^ 
. ^ parking? (2)^ Is there a cafeteria on the premises? 
. . (3) When does the working day begin an'd'end? etc. 
, Description of experience site. - This description 

; - ' includlps both general and specific informatior^ 
aboyf thepOr^bse of the experience site. 



89 

/ 



Task stetements - These are ta^ks identified by 
mutual agreement that' the Students might either 
Qbserve or i^n which they might actually become 
involved as part of their learning experiences. 
• Information on possible learning activities - 
' This includes activities and projects a student 
may do at a specific site and gives^ the prerequi- 
sites a student needs to participate in an activity • 
Based on the information obtained in Step 4, the task state- 
' ments are analyzed and learning activities for students are gener- 
ated for that site. Combining the pther information colle'ct;edL in 
Step 4 plus task statements and the learning activities which have 
ibeen generated, Learning Guides are developed for each Site. Since 
the learning acta vi ties in Jthe Learning Guide are not writjtett-^t • 
the experience site, an additional visit to the site is made to 
validate all information contained in the Learning Quide. After 
the Learning Guide is validated, it is distributed to l^rning 
coordinators for use with students. As mentionecJf* earl*ier, the 

Learning Guide is the product of the Experience Site Analysis. ^ 

' * \ 

This product then becomes a tool for the delivery of inbtruction. 

y 

} ' 
3. Student Recruitment amd Selection Subsystem 

The AeIj/EBCE Program drew its' students from at population of 

high school seniors representing one or more of the following 

cate<jories: * (D a wide reihge of academic 4bility levels; 
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(2) diverse socioeconomic backgrounds; (3) diverse racial and 
cultural backgrounds; (4) a wide ^ange of academic achievement; ^ 
and (5> j3|verse career aspirations. 

From this population, students were sought who (1) were ' » 
eligible for enrollment in the Kanawhar County School System; 

r 

(2) were within one year (fall semester applicants) or one ^ 
semester (spring semester appX4.cants) of completing high school; 

' (3) had specific course requirements' that "could be fulfilled by 
the end^f the academic year ija which th^y entered the program; ^ 
(4) volunteered tp particip.ate with parental cons dnt; (5) hadT 
expressed career interest compjatible with piscgram capability; 
(6) did not participajte in work activities which would conflict 
with the EBCE>i>rogram; (7) did not present unresolvable transpor- 
tation problems; (8) revearled no major health or adjustment prob- 
lems; T^T^ad been enrolled in regular classes in the preceding 

ier suspension -or threat of suspen- 

'not have commitments (e.g.. 




would interfere with involvement in the 

or the 19|73-74 acajdemic year, procedures used to recruit 
students are Outlined in the Student Recruitmeric and Selection 
Subsystem (See Figi^re 3-4) . The process b^ins by obtaining per- 
mission and cooperation from the Kafiawha County schools to recruit. 
Dissemination of information/to students about AEL/EBCE occurs 
next. During this^ear, school guidance counselors distributed' 
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January, 1974 



7 



102 



a b'rochiire describing EBCE to eligible students* Because this 
procedure proved inadequate, AEL conducted twp mass mailings 
(to a total of approximately 3,500 students)-* Additionally', stu- 
dents were recruited through spot announcements and a talk show ^ 
appearance on radio and bV newspaper advertisements. 

• ' « ■ . . h- 

A" list is then compiled of the names of students responding 
to any of the r^ruiting efforts* Arrangements are made for 
those students and th^ir parents to attend a ^roup interview with 
AEL/EBCE personnel* During the interview, ^tudents and parents 
are gi^^en a more detailed descriptioi} of the program, and expresr. 
sions of their interests and needs are obtained* ^ 

For those students who continue to express an interest in 
the program and whose parents consent ta their participation in 
the program, high -school transcripts ^re obtained* On the basis 

• ■ ' • ' ' ' - ~ J I 

of information obtained during th% group interviews 'and infor- 
mation contained on the^H^iglT School transcripts^ EBCE staff 
decides which students are^^^ be admitted to the program* Stb- 
dents are notified of the decision both by telephone and by letter 

- -# 

4* Instructional Delivery Subsystem , . 

The Instructional Delivery Subsystem (See Figure 3-5) is oneCof 
the five basic subsystems inherent to the AEL/EBCE Program. Thi« 
subsystem employs the. outputs of the other subsystems in order^to 
•deliver to the student an alternative form of education* 

For the purpose of this rBport, the In&trjuctional Delivery 
Subsystem is* divided into two component subsystems: Orientation 
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and instruction. ^ Orientation is designed'. to give the studentsltn 

* * * . . '* • 

.ovejTview of the EBCE Program. During the orientation process, the 

staff obtains data on students' ^needs and interests. This, itiforma- 

tion is used to complete the students' H>rbgram Profiles and Program 

i 

Descriptolrs , wfiich- are the firs^ <tiwo steps in tl^e Instruction Sub- 
system^ . . > ^ . 

The' Instruction Subsystem is composed of .eight 'major steps, 

- Each step can be divided into sets o^ procedures', tasks, forms, ^ 
and interactions. 

Based on-fche information obt^iined oh eaph student ,*from both 
orientation anci^studenf recruitment hnd selection^ the learning 
coordinator and t>ie student cowylgte the individual Program Profile 

^ and Progranf Descriptor > Thi« iriformatiop enables the learning - 
coordinator, to identify appropriate learning experiences for the 
student, Thfese leaiming experiences may draw from either community 

^ and rn^ouse resources or Learning Guides (representing experience 
sites) or, both, ^ • ^ , ^ ' 

After appropriate learning experiences and the vehicles for 
doliveri'nq those o^jp'orieftcjes Tiave been ^identifie'd, .Activity sheet«= 
aire developed by the leari|^ng /coordinator and the student in a ohe- 
to-c^e conferehce. The purpose of Activity Sheets is to take a Stu- 
dent through a series of subactivities in order to satisfy his 

.learning, objective. In Step 14 the. learning coordinator assesses. the 

degree to yhich the student accomplished his objective. At this 
point life learrting coordinator must decide if the'student has.com- 

pleted enough work*, to pursue another area. If h^,Jias, recycling 

returns to the \rogram Ibescriptor .;-^ If the, student needs more, work 



in. a particular area,^hen recycling returns to Activity Sheel^s, 



VII^ FINDINGS OF FORMATipE^EVALUATION* OF AEL/EBCE SUBSYSTEMS 

The. intent of this part is to provide a comprehensive report on 
the formative evaluation of the subsystems described in the preceding 
part of this section. The formative evaluatioa report for each sub- ^ 
system ^es an identical format 'and presents the following information 

The critical questions contained in the Formative 

Evaluation Plan " . 

• sources of data 

• Instrum^ts used ^ ' 

• • The schedule for administering the instruments 

• ^ The^data for each question 

Conclusions, recommendations, and actions taken to 'date are then 
presented for each Subsystem,. • ' . 

A. Subsystem: Experience Site Identif icatibn and Recruitment* 

1. Question 1:* What is the relative effectiveness of items 

, in the Public' Relations Packets? ^ • 

/a. nata Sources: N/A ' ^. . . 

l>. T n'»l ruincnts : N/A 
c. Admlnistratiop Schedule: N/A 

(1. Data: N/A ^ ' ' ' ) ^ , 

- * ♦ 

. 2. ^^uestion 2: Why do employers (rof use/agfee) to^participate? , 
^ a. Data' Sources : 45 'experience sites; site analysis t^artt 
b . ;^nstrumcnts : Combined with summative evaluation instru-r 
ment (quostionnaire) ; s^Lte analysis team interview / 

c. ~ Administration Schedule: Mid--January and mid-February 

d. Data: ' ; 
(1)* Sixteen of 45 (36%) experience sites responded 

"♦to the summative evaluation questionnaire ^ ^ ^ 
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The. first scale asked, "Hgw important do you feel this 
learning is?" • The secdnd scale asked, "How effective V 
do^you feel ,the project has been in accomplishing this >^ 



learniiig?'; The responses to these scales are presented 
in Table 3-6'. The data were analyzed 'by using a t-test 
for correlated samples. The t value 1.00. was not 
' significa^^. To be significant, the' critical value of " 
t ha^ tV exceed 2.'145"at the .OS JLevel. 

« y ' 

t _ « 

Question 4: is the Career cluster Distribution Matrix accurate?/ 
Does distribution of sites pver clusters match student needs? . 

a. Data Sources:' Comparison of Learning Guides aga^t 
Career Cluster -Distribution Matrix; students ' ' ' 

b, . * Instruments: , No instrument needed for first p^t of ^ 
question; questionnaire - Students' Perception of Experi- 



^ • ' ence Sites i ' ■ , 

c. Administration Schedule: Atter students finish site visits 

/ ^ , 

^ d. Data:- ' ^ 4 ' ' ' 

(1) ^ learning Gui'des were validated by the employ er9 

and revised if needed. 

(2) Students w3re asked to' respond to the following ' 

• ^ • i , ' ^ . 7 

' ^ question: ^re "Students given- their choices in " 
site placements? Forty-six students JrespcTnded - 
\ to the question with the following results: ' 

55% > Yes * - , ' 



9%, Doti't know 
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" 1 • , '26* No ^^^-^ 

• * ■ 



instruments were given to all resource people via 
the contact p^r^on. On the average, 2,06 responses 
per experience site were received* The resource 
people responded to the following questions: 
i '^(a) How did ypu become involved with EBCE? 
^ 19_ EBCE personnel Contacted me, 
1 A student talked to me, 
1 Another employer talked to me. 



0 



12 Company pers6nnel talked 'to me, 
(b) Do you plan to continue participating In EBCE? 
20 Yes \ . . . . 

. • ' _0 No ' 

, / ^11 Don' t know 

i * 

(2)' The site analysis team responded to. the following X 

^I^^stion; Did any experier^ce site refuse to 
• • • ' 

participate? 
" ' 39 'No 

Question 3; Do participating^ployers feel the'*program as it 



functions fits with what t^gj^ were led ,to jexpect 

a. Data Sources: 45 employer^ 

b. ' Instruments : Combined^ with summative evaluation instrument 
'c. Administration Schedule: Mid-February ^'V.'*^ 

d. Data: Resource people were asked t^> rate items;^ dealing 
with importtrnt areas of student learning on two scales,/ 
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TAELLE 3^ 



EMp^iOYERS' OPINIONS ABQUT STUDENT LfeAF^ING 



How l^^rtant Do you 
reel Th^s Earning xi"^ 



Frequency ; 



:^ot Highly 
important ^^^ZQpc^rtant 
1 2 3 4 ^5"' 



Students learn to: 

a. Perform specific 
occupational 
skills 

b* Be punctual and 
organize their 
tlffle 

c. Assume respc^s- 
ibility for 
themselves 

■ d/ Make decis ions 
and. follow 
^through ' 

e. Communicate 
with others 
in a mature " 
way \ 

f . Be aware of 
no re career 
opportunities 

g. Work with^ i 
others \ 

h<> Cvaj^ate their 
o%m wprk* ^ 

i. Perform basic 

academic^ skills 
•* • 

ThiHK through 
and solve 
- problems ' 

k. ^ave a poAtive 
attitude toward 
self^ 

1, Have\a "J>ositi^e 
attitude toward 
work " 

•» 

A. Have a positive 
attitude toward 
learning 



n. prepare for 

further educatior 

o. Improve inter- 
^ pertorial and 
social ^lls 



1 4 5 7 14 

0 0 3 7 21 



O' 0 2 ,8 23. 

r 

0 0 ,^6 i 19 

0 0 ' 1 12 19 

,0. Or 5 7 20 

.0 0 2 9 21 

o 

0 0 6 8 15 

0 1 5 10 15 



0 0 6 7 19 

0 0 * 3 • 7 22 

0 0 i 5 25 

0 0 1 4 27 

.1 0.3 5 23 

0 0 3 11 18 



Mean 



-3.9^4 



4.58 



4.64 



4.41 



<.56 



4.47 



4.59 



3.69 



4.26 



4.41 



4.59 



4.72 



4.81 



4.53 



4.47 



HoW Ef fcfctiv* Do ^u reel the Project j- 
Has Bean in Accomplishing T^is Learning? A 



Fre^< 



N<it « ft^^ighly 
Effective ' T-ffcctive 

,12 a / 4 5 



1 2 15 , 4- 6 
X 3 11 ,.^9* 5 
14' 9 7 ^ 

2 3 15 5.4* 

X ^ 3 11 -7 7 ^ 

X 0 10 .8 ,9 

• ■■■ ■• X 

r 

■2 0 ^10 8 9 
"l 4 15 3 4 

2 1 14 5 5 ♦ 

s 

•> 

1 3 15, 7, * 3 
1 ^2 14 7 5 
1 ' 6 8 6-7'' 

1 4 12 4 8 

2 2 9 6 8 



1 2 



Haan 



% 

3.43 



3^48 



^.59 



,3.2. 

i 

3.90 

3176^^ 
3.19 
3.37^ 
3.28 

3. '55 

3.43 

3.48 

3.59 
t.5o' 



4 



J 



ERIC 



if • 



Conclusions 



The re^lative effectiveness of the Public Relations Packet 

*^;5^^cpuld not be evaluated since at this time it does not exist 

Some public relations m^teri^ls for the AEL/EBCE Program 

do exist and are distjMbuted" dn the basis of the user's 

need for the information. The development of the Packet 

is a recent responsibility of the Replication Unit» When 

the Packet is finished; evaluation will examine 'both 

the accuracy of the information in it and the effectiveness 

of the Packet to all potential repipients^. 

b. The formative evaluation of the question, "Why do employers 

agree/refuse to participate?".- was done in conjunction with 

the summative evaluation. There are two reasons why this 

was necessary: . . ' 

. . / ^ - 

^' 

(1) Employers donate their time; therefbre, it' would 
be unwise to request^ information twice which could 

be gathered in one step. . * . / - ' 

(2) Two similar questionnaires could damage the public . / 
rel^ations between the project and employers. / 

The 13 resourcVpeople who indicated tl)at they *did*'not ^ ,y' 
know the status ^ of . participation for the fpllowing'^year ^ !^ 
'stated 'that that decision wa%<up to the experience^ site*' / 
The-/esource people indicated that the EB(fE "staff/ reef i^i t^s ' 

/ ■//•■;/ 

.them primarily, although othel: coi;npany personnel and^^ 

students also do a high percentage of the recruiting*^ 

The site analyses team indicated that one of the 40 ;^ites 

^ . • 
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^^^m^.-'-^Av :.y:-fvt-; ;v: ''^^^/,, 



- v/- v./-;^/-'-- ' ' ' • / •/ 

'/\J' -y-^^f^'^^ di'd ^P^^Wl's^'.ya coh^^^^ parti9ipating in the.^efe. ' p 

v . . ' y. ' ^'^^^^ • ' ^ V^® arialysi> indicated/ i^^^ 39 .experl- ' 

i//. ' / / . BTioe sites were very, receptiye.^to EBdfey ■ / * , " ' : 

_^Apparentily the resource people/ feel tjf^^^ 
^; ' ' tiooi-fi^-asr^it .should. /X.^ ' /. v. 



significant at'^t|i< .OS l$vel pjf con'fideia6e^//even though 



vhat should' Kappen had a higher mean than- what- 'actuaiiy / 
happened-. The accuracy of the distribution of the- Career 
* 'Cluster Matrik when cofi^jared to Learning Guides' j.s a con- 
tmuous ongoing process^ Each Guide is validfited by , 

' * i ^ ' ' ' , ; ' : 

employer^* whep completed. The students feel that site 
> ^ placements represent their interes^t 2a:eas; An explanation "for 

^ ^ _ . ' ir the 26 percent who indicated no was due to the site placement* 

/ ' * » . ' ' ' " * . ' 

* ^ ^ ^ mecharjism. If ar si,te was filled, a student had to wait 

' • ' . • * 

' ' .'• until > vacancy odcurred. The waiting time ^as ^anywhfere 

' fj^om approximately one to J^hree weeks /Although^ learning* 

r , ccordin,ators attempt to place the student in a similar 

' ^ ♦ '.V ■ ' . t' 

/ * ' ' site,. It is not always' ^sTsibliB/ .Iw' r V • 



A 



6* , 'Recommendations and Relevant Progriun Action ^Vy^- 



This part . of the formati\|re evalua€idn. section li^Vs the recom- 

' - ■ ' • . ■ /• • ''-^ ' -^'^ 

r ' mendations and relevant program "^actidtts . There is no imtilication 

V^at the formative evaluation- recommendations Caused progreun^ 

^ . ' • ^ ' ♦ •/ • ' ■' 

- , actions.- The. process is interactive in nature; in jfjact, the action, 

' y ^ . y * '^Z - ' \ ' / ^ 

* , / taken by the staff may have preceded the' initial recbmmeridatioh^y 

* / ^ ' ' 'V ' * , ^ " 

' Evaluation. , I I: ' ^ - ' 
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' — - V .'I ? ' — 



A'Otion: 



v:'^'// Tl>!^ deyelopiji'ent ot .th^ ' Publi c 
; ' - ^'^'R^l^tions Packet shbuldvi)e , 



accomplished^, in time to penoit 



I an extqpgive ^evaluation., y ' 



b.' GoiranUni^ation bet;ween iexperi- 
' -Boe^, site r.esotirCe people and 
■ : ^' the AEji/EBCE' Program should ^ 
^'•'b'e streri^hened". 



^, a*/ The ,nuinber !of experience 

; ' * . 

sites*, fb'r each of, the Worker 
'Trait Groups should be 
. ' . increased. 



' Establish^ a -Replication 
Novecnber, 1973, 




erationalized tJ>e Unit ih / 
January, 19/74 / r^/ ^ 

, ^ ^ y 

a.:?. Assigned ma^or .responsibility 

for deve lapping Pa cJ^et' .to, , 

" / /' ' '/ » ' 

ReplicatJ!on Unit, , 

• ;'-';V'\. 

a. 4. Set , timeline of February 'to ' 



b.l. 



b,2. 



b,3. 



b.4. 



b.5. 



c.l. 



c, 2, 



/August, -\974 for d^VelQ^iQ6nt 

// : - ' : ' 

\ of Jacket ... V ; 

" . ' y ' 

Recognized ^the problejn in r' " 

Septemberv 19-73^- /—•-I' 

Ueld staff meetings to address 
problem, ' ' 

Made decision in Decei^ber/ 
,1973 iio'jiold an in-service 
training session. for resource- 
people and contact peopled 

Completed development , of *^ 

training package in December, " 
« 

' I9-7i3. 

Planning for experience site . 
in-service training session 
^ in April, 1974, 

Recognized the problem in 
December, 1973, 
Conducting a study, presently 
underway by Design and Evalua- 
tion staff-jT 



Recoiriinendati.ons;: - - Act:^'n ; 



. \ 



C'. 3. Projet^ed date tot comple- 

/ 

. ' tio^X' of Study -A^'il, 1974^ 



v' 



H., Sjubsystem: Experiehx:e\Site Analysis 
^ . 1/ Question 1: What; training- is needed by the analysis 'team? ■ 
/ ' (a) .Who doea Lt?^ (bj Howjmuch" time is needed? (c) What 

trainihg materials are used? ; (d) Is it effective?- 
a> Data Sources: Design staW; site analysis team;, 
^ ' in-house documents 

b. Instruments : Que;stionnaire;, interview 

c. Administration Schedule: January 

d. Data: , _ 

(1) The Design s1;aff' res^Jonded, to the following ^ ' 
' questions:^ ' ' ' ^ ' 

^ (a\ Who does the traininq? 
- : . The training of th*-* sito ^in.i 1 y.s i 'toain 
• ' ' waii done by two members of Design staff. 

* ' " ^ (b) How much time' does it take to train the . - 



V site analysis team? 

'/ ^ According to the Design staffs i^ takes 

:% \y approximately twelve to fourteen hours. 

•.*:''';',' ^ 
lc)\ What training materials ^re used? 

Training materials wer^ developed by the 

Des'ign staff. 
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(d) Is the training effective? • , 

According to the Design staff that did ; 
the- training, thajjtraining was effective, 
(2) The site analysis team jiesponded to the followirng 
questions : 

(a) Who does the training? 
The training of the site analysis team- 

w^s done by two members of the Design staff. 

(b) f^ow^uch time does it take to do the 

f 

» * training? * 

According to the site analysis team, two^? 
days are needed. . % 

(c) What training materials were used? ' 
'Training materials were (Jev^loped by the 
Design staff, 

id) Jts the training effective? ' 
The site analysis toam indicated that 
, training was Gffc^cLivp. * 

Question 2: ^^at is the average time/site analysis? 

a. Data Source: Site anal^ipis team; Design^ staff ^ 

b. Instruments: Interview; questionnaire \ 

f 

c. Administration Schedule: January* 

d. Data: * ' 0 
(1) The sit;c analysis team responded to the following 

question: What is the Average time/site analysis? 



r 
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The site analysis team indicated approximately 
3 to 3 1/2 hours; and 1 to^ 1 1/2 hours are 
needed for interviews. 
(2J The Design, staffs responded to the following 

question: What is the average time/site analysis? 
The Design sta^f estimated that 12 hours were 
"^necessary . 

Ouontion 3: Who translates site analysis information into the 
fincil product of the analy-sis: Learning Guides? What is the 
aveiragp time per Learning Guide ? What difficulties are encoun- 
tered? ' 

a. -'^^Qata Sources: Design staff; site analysis^ teain 

b. Instruments: Interviews 

c. Administration Schedule: January 

d. Data: Both the Design staff and the site ana^sis > 
team rrspondod identically to the following questions: 

(1) who trnnslntes site analysis information into** 
I final f^roduct of the analyr;is?^ 

Both groups^ indicated that the person on the 
site analysis team that analyzed^ the site 
was responsible. \ 

(2) What is the average time to complete a Learning 
Guide once the analysis is. completed? 

Both groups agreed that the time will vary -due 
to the complexity of the site. The 'estimated 

• c 

^ time was 1/2 fiour to 2 hours. . 

ICS'S 'J r; 



(3) What difficulties are encountered? 

The site ap^ysis team indicated the major 
probl^iT encountered was ifi. presenting the • 
information (format) . ^ 

Question 4: Are Learning Guides useful to students and learnin 
coordinators? (a) Format OK? (b) Is the information clear? 
(c) Arc Learning Guides used?/Can a learning coordinator pre- 
pare a student Activity Sheet from information in a Learning 
Guide? 9 

a. Data Sources: Learning coordinator^ ; random sample 
of 11 students 

b. Instruments:, Interviews; questionnair.e ^ 

c. Administration Schedule: January 

d. Data: 

V 

(L) The learning coordinators responded to the 

A 

following questions: , 

(a) Are the Learning ^ Guides useful? 
2 "^^s; 3 No • 

i 

The respondents indicating no stated 
they could not judge their usefulness \^ * 
^ because the Learning Guides were not | 
available. 

(b) Is th^ format OK? 

I ' s ^ Yes; 1_ Don't know (because not 

available) ^ * 
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(c) ^ Is the information clear? 

4_ Yes? '1^ Don't know (because not \ 
^ ^ available) ' \ 

vCd) Are Learning Guides \ised? 

3 Yes; 1 No; 1 Don't know 
(because not available) 

r * 

(e) Can a learning coordinator prepare a 
student Activity Sheet from informa- 
tion in a Learning . Guide? ^ 
1^ Lcarnirig Guides not available — 
,X?on^t know; 2^ Sometimes; 1^ Depends^ 
on the students' needs & interests 
(2) The students responded to the following questions 

(a) When you want to find out something 
about an experience site, do you find 
the Learning Guide helpful? 
10 Yes; 1_ Sometimes 

(b) Is there anything that is not now 
inclu^fed in the Learning Guides that 
you would like to know about the sites? 
(6 No; 2^' More information about 
sites is needed; 1^ Need to include 
student comments about experience, 
sites. 

(c) Do you find the way the information is , 
presented in the Learning Guj;des makes' 



Lng Guide 
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it ^easy for you to fi^d what ^oyl want . 
. . ' to know? ' - ' . 

. • IB -Yes;,. 1^ Usually 1 s ^ 

Conclusions ^ 
,a» Based on the congruence of information received from the 
Dcsiqn staff and the site analysis team, the question 
• rcqarfiinq training needed by the analysis tecun is clearly 
un(l(*i '^tood b'y both groups. The. effectiveness of the train- 
ing IS substantiated by the number of experience sites 
that =werc analyzed* Thirty-nine of, the 40 experienbe'^ 
sites indicated a continuing interest in the project, ' One 
indicated an unwillingness to continue participating ' 
, because of the' students that w«re sent, ^ '/ 

b. A discrepaticy was found in the estimates for average time/ 
. site analysis. The Design staff indicated 12 hours were 

T. noeded. The site analysis team estimated 3 to 3 1/2 hours 
Willi I L(i I ]/? hours njeeiJed for iritorvif-vinq the expori- 
t^nn* sit(^ p(^r':<)nnel, v i ' ' 

-\ ■ 

c. No discrepancies were lound when the Design staf^and the 
site analysis team were interviewed about the translation 
of siie analysis information into Learning Guides , the 

r average* tfime required per Guide , and difficulties ^encoun- 
tered. V / . 

* I 

d. Learning coordinators were mixed, in their statements adDout 
use of the Learning Guicjes * Three indicated they. were used 
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and three indicated they were not used. Because of these 
data, learning coordinator s^^i^Kat gave negative responses 
indicated that all Learning^ Guides were riot ,j(vailabl^ j 

~^ 't fir-- ' I- " 

therefore, their usefulness was questioned^? It should be 
noted that"* 54 Learning Guides have been developed but "onl^ 
9 have been delivered from the^rinters • 
'e. Learning coordinators indicted the usefulness of the 

Learning Guides wouj^a be increased if examples of cictivities 

\were located ip^ach Guide * ' ^ 

^ , y '* 
f . The studQi(ts answering the question of Learning Guide use- 
fulness responded positively in'most cases. 



6, Recomaendations and Relevant Program Action • ^ * 

Thi^ part of the formative evaluation section lists the recom- 
mendatfbns and relevant progrcun actions* There is no implication 
-tlyrt: *the ^^ormative evaluation recommendations caused program ♦ 
action^ The process is interactive in nature; in fact, the action 
takeh by the staf'f may have preceded the initial recommendation by 



evaluation. 
Recommendations : 



/ 



/ 



. Action: 



a. The site analysis team train- 
^ ing waSc judged to be success- 
ful. Therefore, effort^ >c 



should be channeled into other 
areas of need. 



a/. 1. Developed lence Site 

Analysis Trairting' Package 
a. 2. Channeling sjtaff efforts 



into dtRer areas. 



RocommendntionF: : 



Action: 



b. 'The use of .Learning Guides^ 
,would be increased if the 
Guidesj^were^ available. 
Therefore, it^'is recommended 
that Learning Gui^ies be made ' 
available as soon as possible. 



The Learning Guides 
should ii^lude examples of 

acti^iti^s in order to facili- 

V 

tate' the writing of Activity 

0 

Sheets . 



'b.l. Recognized by Design staff ^ 
* ' . 

• as a problem- pifi6r to staff 
in-service training / Septem- 
ber, 1973, 
b.2j' Recognized by Operations 
"staff as problem prior to^ 
student orientation, 197^. 
b.'3. Developed Experience Site, 
Analysis Training Package ^ 
0- (by Desi.gn staff) . 

I 

b.''4. Trained experience site 
analysis team. 

b.5. Set timelines for experi- 
ence site development. 

b.6. Developed • Learning Guides 
and sent to printers. in 
January, 1974. ^ 

b. 7. pelivered Learnipg Guides 

ift March, -1974. 

c. l. Preparing recoiranended actions 

i 

to be given to Stabilization 
* Management Team during the 
next meeting/ 



v 



C.2. Document" decisiori. 
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Subsystem: Stjadent. Rec2?tiitment apd Selection * f 
1- Question "1 ,What ai?6 thj^relative effects of .the. different 
methoc^s used tp -aoquaint students .with^EBCE? ' , 



( 



a. " Data .Sources: Students ;v learning 'coordinators ; 

•in-House documents i ' * N 

♦ \ , ^ 

, * % ' 

b. ^ Instruments: 'vQues:tionnaire 

c. Administration Schedule: Steptemberj January 

d. Data: . k - 

(1) . Qu'ring the first • recruitment in the -summer 
^ of 1973, the goal was to recruit 100 stu- 

dents ^- 50 experimental and 50 control. 
Forty-four students were recruited using ^ 
the following methods:* ' , , , 

(a) Pamphlets distributed to all 

V 

senior homerooms; 3800/ distri- 
buted; . 79% Returned. 

} 0 

(b) r,(-tt(-rs .(first mailinij) r;cnt to . 

>^ .1 
students homefe; 2800 distributed'; 

2.7% returned., . ' 

(c) Letters (second mailing) -$^ht to ..^ 
students' homes; 1000 distributed; t 
1.6% returned.' 

(2) During the second recruitment in December, ' 
1973, the goal was to, recruit .100 students - 
50 experimental and 50. control. Twenty stu- 
dents were recruited using the folTowing 
procedure: 

111 *^ r: 
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(a) , A meeting was held with school 

co^inselors apd principals in all',^ 
eleven schools to explain tl>e AEL/ 
EBCE Prpgram. The^selection>*cri- 
teri*^ were explained ,to school 
personnel. ' • . 

(b) The counselor^ and principals were 
asked to, select the students that 
they felt would be rnterested in 
the progiTcun. , ' , ' 

(c) A team from AEL/EBCE (including 
students) presented the goals and 
objectives of the program t^ |*ie^ 
students selected by. the school 
staffs.' o * . 

'(d) Those students who ai5tendcd..tl?e' 

mtM^tings and expressodv an int<^ro.st ^ 
W(^TP naked to cdmpJc^to <i ^]u^v.^i()^- 

^ 

nairo. Eighty to ninety ^studt^ntr? 
expressed -interest, 
(e) From the questionnaires received, 
jSffl^nt interviews were scheduled 
over two-day period, "iy^nlsy-f ive 




parents c^ttended the meetingsV 
(3) nbring the third recruitment in January, 1973, 
the goal'was to test a different system for 
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student rccifuitinent. Twenty-fov^ students 

wono, rpcfM.ited usiAg the follow^q methods: ' 

(^c>) 'The recruiting effort stressed • 

^ . ' ' *\ 

public relations, apd -explanation 

V , ^- • ' • . 

o^f the program to school staffs, 

(b) The effort concentrated on three , 
high', schools.^ ^ . ' ' , 

(c) ^ The AEL/EBCE Program was presented 

^ ^ ' \. ' 

to' principals . an5 counselors. 

(d) ^he .AEL/EBCE 'Program was presented 
to seniors in lar^ge* group meetings. 

Students werfe\asked during both orientations " to 
respond to the'" follov^ng citie5tions ^oncer^ing 
the project recruitment effort;* ' 
.(a) How idid you first find out| about - 
the EB€E Program?' ' » ' : ^ ^ 
The student res|!>onses during. bqtK 
orientation periods were very sirrtilar:^ 

(1) , Received a letter about the; ^ 

program in t^fe.mai*. ' • . 

(2) Picked up, or were given a pamph- , 
let about the proga^am in school.' 

(3) Heard about the progxaln' dn a * \ 

" ■ \ ' ^ ' . 

r^di*o station, j - • i> 

» (4)f Heird about the program from ■ ^■ 

• a hi<^h school counselor. ' f 



r 
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(5) Heard about the program from 

a friend who was in the program 
last year* 
(6^ Heard about the program in an 
* , assembly at school, 
(b) In your opinion, what is the most 
efficient way to let students know 
about the EBCE Program? 
(1) Through the mail , • 
i (2) Counselors 

(3) Assei±>lies by staff members ^ 
. at home schools 

(4) Through other students 

(5) . Invite interested students 

to spend a day at the EBCE 
site 

(r) \\\ your opinion, Sfed*\o do^ qood job 
in ciescr^bing the^raci: Program? ^ 
_ 62% Yes 
11% No 
27% Unsure 
(d) What improvements can be made in thi^s 
area? 

(1) Clear up tl/e misconception 
that the program is just for 
dropouts . 
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(2) Send AEL/EBCE staff members 
to the schools : 

(3) Start recruitment earlier 

(4) Send AEL/EBCE staff members 
and EBCE students <to the 
schools 

Learning coordinators were asked to respond to 
the* following questions: , ^ ' - 

(a) How well do publicity materirals 
represent EBCE? 

l_ Materials reflect the nature 
and purpose of EBCE very well. ' 

2^ Materials reflect the nature 
and purpose ,of EBCE fairly well. 

2^. Materikls reflect the nature y 
and purpose of EBCE somewhat. 

(b) What are your suggestions for 
improving the materials? . 1 
(1) We need to be more realist^ic 

J and^ not offer something we > 

can't deliver. 
(^) We should use Worker Triit 

Group and Concept/Objective • . 

cards more extensi-vely 
(3) Kmployers and former students 

are needed in the recruitmeat 

♦ 

effort. 
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; ' * (4) parents should be used. \ 

: tS) ' Shou]^d-have more inter- \ 

^ , action with students, . -j . 

community arid schools. ''^-^ S 

Question 2: What criteria are actually xised to select students? 

a. Data Sources: Those people who select students; 
- student:. Tfeeds ^ " * 

b. Instrumehts: 'n/A ^ 

c. A'dministr^ation Schedule; -N/A ^ ^ 

d. Da^a: ThoV crit-cria for stiident selection are 
outlined in the; Operatironal^ plan as follows: 
(1) Are eligible for enrollment in the ' 

' ^ Kanawha County School System. ^ * 

\ (2) Are within one year (fall semester 
applicants) .or one semester (spring 
semester applica^s) of completing 

* ' high school. ^ 

' ' . 1 , 

(3) Have' specific course requirements. 

that can be fulfilled by the end. of , 
the academic year in wHich they enter 
the progifam. 

(4) Volunteer to participate, with 
. parental consent. ' \ 

(5) Have expressed career interests com- 
patible with program capability. 
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C6) Do not participate in work activities 
which woul4 conflict with the EBCE 
Program. } ' 



(7) Dcxnot presen"^, Ainresolvable tramftr- 
poYtation problems. 



.(8) Reveal no major health or adjust- 
ment problems. 
^ (9) Have be^n . enrolled in. fegulay: classes 
in the preceding school -^erm. 

(10) Are not unidar suspension or'-threat 
of suspension by any school system, 

(11) Do not have comnitments (e.g. , band, 
athletics) which would interfere with 
involvement in the 6B<JE,5tt?gram': 

For the February recruiting e'^o^rliTthe crit^zila 
were changed slightly. Number d^- -<^jedite^'eectetrrt^ 
was modified to 1 1/2 and no more thSfn-"'^ipajor 
^ areas of study, and the students must \>:4^w4±iin 

' ' \ -^-^ 

1 semester of graduation. '< \ ^ ^*~" 

Question 3; How functional \aure the selection^Biteri^?^^ 

a. Data Sources: Design unit y\- 

b. Instruments: Interview ^ v ' 

c. Administration Scliedule: January >^ ^ 

d. Data: Mentoers of the Design staff were asked to rat^',^ 
each o§^Jth^ student selection criteria and indicateVj-I * ^ 
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"Yes, it was useful" or ."No, it was not useful". 

Criterion No. Response 

1 Yes ' 

2 Yes - but some juniors were admitted 

3 Yes 

'4 Yes ^ 

5 Yes 

o ' Yes 

"7 No 

8 ' Yes 

9 NO 

10 No 

11 Yes 

Question 4: Why do students choose (to participate/not to 
participate) in EBCE? 

a- Data Sources: Students; students that transferred 
back to thoir home high school 

b. Instrumontfi: Questionnaire ^ 

c. Administration Schedule: September; January 

d. Data: * 

(1) Students were asked to respond to the following ^ 
.question: ' Whae^eatures of EBCE do you like 
the most? 

r 

(a) The program itself. 

(bl Friendly people, 

(c) Change from high school. 
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(d) Unconventional study methods, 
t 

(e;) Freedom of choice that the 
program allows. 

4 

{ f ) Independence • 

(g) Not in a classroom. 

(h) No specific schedule.' 
(l) Job site exp^iences. 
C3) One-to-one interaction with 

learning coordinator. * 

(k) Ttie * independent studies. 

(1) Opportunity to work at places \' 

\ 

not available to an individual, 
(m) Personalized teaching, 
(n) Great amount of job experience 

and the variety of people. ^ 
(2) Students who returned to their home high school 
wore asked' to respond to the following question: 
\ (*nn xy<^^ state the reason(s) why you decided to 
/ ' Ic^^vc the prograjn? 

t (a) Schedule conflict (sports & 
jtb) (2) ^ 

(b) Parji-time job as a result, of 

site placements (2) ^ 

(c) Parents dissatisfied and trans- 
portation (2) 

'(d) Transportation (1) , 



(e) Unwilling to fill out necessary 
- forms (1) 

(f) PKt^qram incorr^^ete for student's 
ne^ds (1) 

(g) Beyond control and don't know (2) 

Conclusions 

a. The first and second recruitments were not successful. The 
required pumber of students was not recruited, and a poor 
response rite was observed. For the first recruitment, a 
panphlet with a return requested was sent to high school 
students. The response rate was very low, due in part to 
an error in postage and the return form. If the student 
returned the pamphlet, it was addressed m such a way that 
it was returned to the student, not -to EBCE, Potential 
student loss due to these errors cannot be determined. The 
third recruitment was apparently success'ful based on the 

_ number of responses and number of school visits. All 

recruitment efforts were seriously hampered because of the 

late funding by N.I.E. The agreement with the Kanawha 

County School System was that AEL/EBCE would not r«crtiit 

until the contract Was finalized. 

i 

b. Based on student responses to a questionnaire given during 
orientation, students heard about the ABL/EBCE Program by 
six methods. Students cited five ways which they felt 

^ would be most effective in communicating the AEL/EBCE 
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program to students. Additional modi fiqat ions of the 
recruitment subsystem included a polished presentation, 
and- a follow-up of all students expressing interest in the' 
program.. .AH the improvements suggested by students have 
been addressed by the third recruitment svibsystem. 

c. \ All 'learning coordinators viewed the publicity materials 

i as "being very reflective" to "somewhat reflective" of ^fehe^ 

Ji» ' ^ ' - 

% nature and purpose of AEL/EBCE. The learning coordinators 

stated five ways the publicity materials could be improved. 

d. The selection criteria^, as viewed by selected members of* 
the .Design unit, appeared to be useful. Criteria seven, 
nine, and ten were reported not useful. 

e. The students who responded to the orientation questionnaire 
. indicated 14 reasons why they liked the AEL/EBCE Program. 

These reasons fall into the following five major categories: 
friendly people (staff and students), independence, site 
^ experience, one-to-one interaction," and scheduling., 

f. Only ono student who had returned to hi^^^home high school 
" indicated that the program did not meet his needs. 

g. Whether or not the AfeL/EBCE recruitment Effort reached the 

^ appropriate target audience is questionable, the difficulty 

is in dofining "target" audience. Js the target group all 
seniors in the Kanawha County School System or all seniors 
who volunteered in Kanawha County? 



KLC 
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6, Recommertdations and Relevant Prpgram Action 



This partt of the formative evaluation section lists* the recom- 
mendations and relevant program actions. There is no implication 
'thatvthe formative evaluation recommendations caused program 
actions. The process is interactive in nature; in fact, the action 
taken by the staff may have preceded the initial recommendatipn by 

-rr- 

evaluation. 



Recommendations ; 



Action: 



The third rec/ruitment siib- 
system should be oper^tion- 
alized with modifications based 
on staff and student inputs, 
T^is is probably the one mpst 
significant factor in^develop- 
inq an adequate timeline j^r, 
recruitment* 



b. The selection criteria should 
be examined critically. 
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a,l. Recognized that first and 
second recruitments were 
• unsuccessful* 

a, 2, Developed a new svst^em for 
recrijitment which incorpor- 



> ated staff and st:udents' 



a. 3. 



a. 4, 



b.l. 



b.2. 



suggestions • 

Initiating student recruit- 
mcrtt for FY 75 in March, 
1974 

Incorporated suggestions by 
staff and student^ in- FY 75 
recruitment, . ' 
Presenting recommendation to 
Stabilization Management Team 

% 

at their next meeting, ^ 
Documenting decisions. 
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Recommendations ; 



Action: 



c. Communication with parents 
should be increased. 



d* The transportation problem 
should be re-examined* 

7? 



c. l. Presenting recommendation to 

Stabilization Management 
Team at their nex% meeting* 
C.2, Docum^ting decisions. 

d. lr Presenting recommendation to 

Stabilization Management 
Team at their next meeting. 
d.2. Documenting decisions. 



Subsystem: Instructional Delivery (Orientation) 
1. ' Question 1: Do learning coordinators have all information 
needed to* complete Program Profile? 
.a., Dat/^Sources : Learning coordinators c 
b. Instruments: Interview 
' c. Administration Schedule: January 
d. Data: Learning coordinators were asked tp respond to 
the^ followiiig questions r' 

(1) ^ Do you feel you have all the information 
you need about each student when you 
attempt to complete the Program Profile ? 

(2j ' If you responded by indicating No, what 
, items are typically lacking? 

r 

5 Transcripts; £ Diagnostic results; 
£ Interaction with students; _3 Infor- 
mation eObout students aptitudes & abilities 



\ 
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' (3) IS therd' ^ny other iriformation that * :^ 

would be helpful? j , 

(a) A complete list of courses 

with description that a student 
took at his home high school, 
^(b) Additional interaction with 

o - , 

students . 

Question 2: Is the Program Profile used by learning coordi 
nators in preparing the Program Descriptor?/If no, why not? 
a. Data Sources: Learning coordinators \ 
b\ Instruments: Interview 

V 

f 

c* Administration Schedule: January . 

d. Data: Learning coordinators were asked the foltowing 

* ■ I 

questions : 

(1) Is the Program Profile helpful in filling ^ 
out Program Descriptor? 

^ . Yoh; 1 No ' * 

(2) ' Tn thoro nrly information that i not In the 

Program Profile that is noodod to fill out 
the Program Descriptor? 

Transcripts; diagnostic test scores; \^ 
descr-iption of courses offered by each 
^l^lqh- school. 

(3) ; Can you think of any changes in the format 

of the Program Descriptor ? 

V 

£ No; £ Yes ' 

f 
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Question 3: ^ How n^ny students return to their home hi^ 
schools after their -first week^in EBCE?A^hy do they choosq 
not to participate? 

a.*^ I^ata Sources*: Learning coordinators and Director * 

of Operations 
b • Instruments : Interview ^ 
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Administration Schedule: First week of orienta:€ion, 
September, 1973 ' 
d. Data: The learning coordinators and the Director ^ 
of Operation^ indicated one student left the pro-; 
gram during the first week. The reason cited was 
the number of forms, tests, and materials he had 
to fill out, v* ^ ■ 

t- 

Question 4: Are students satisfied that -their needs and ^ 
interests are accurately Reflected- in the Program Descriptor ? 
a- Data^blources : Students 

b. instruments: Interview 

c. Administration Schedule: January 

d. ^ Data: Students were asked to respond to the^rollowing 

questions: ^ * - , | 

(1) 'Which of the following information is' 
needed to fill out a Program Descriptor? 
§. ^ Transcripts 

2 Yes; 1£ No: Achievement Test Scores 
9 Y^es; 3 No: General Ability Information 



(2) Can you think of any other iyiformation 

♦ • 

that is needed? 

£ No; 5^ Students* own 4-nterests, 
•needs, and activities plus other tests 
taken :^uring orientation; 1_ Only * 
the information that ^ would help the 
student coordinate his interests into 
•the correct atea of study. 



Question 5: Do students have enough information to make 
appropriate selections of experience si^es?/Do th^y feel 
free to request sit'es not already participating in "eBCE? 
^ Data Sources: Students 

b. Instruments : Questionnaire 

c. Administration Schedule: September; January 

i 

d. * Data: Students wer§^,asked to respond to the followin 

questions: * » 

(1) When you filled out the l^xi^erJ en6c Site 
selection Forfn ' dufifig orientation, did 
you feel ^s if you had enough information 
about the various sit^? ' 

2 ' Z No ' ' 

(2) If No, s^at additional information is 
needed^ 

Ij More information should be given 

explaining what .goes on at the various 
sites; 2. During the first semester not 
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information faas give 



/ ^ enough information ^as given befoxehalid 

^ ~ ». , * 

on any particular job site* ^ 

(3)* If you filled out the Experience Site 

I ' Selection Form now, would you choose* tjie* 

i same sites, again? o - 

5 Yes , I would choose^ the* sape^ sites ; 

^ " \ • . 

2 No, I would riot cHbose the same sites ♦ 

- (4) If No, what changes would you ^ake? / 

^ (a) . I haven't been to any sites 
• * 

th^t i chose yet, 
i« (b) I would 'choose a smaller " 
^ ^ organization; , * ^ ,9 

(c) some of ^ the sites I originally 
^ selected did not relate to my 

^ interest areas. 

(d) I would ask for other placements • 

(o) ifjoihc I woul^uhoosc over;, some . ' 

. V . . ' • 

I woiild not. 

(5) If you wmted a site placement which was 

)t a participating site, ^kt would you 

do? ^ 
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12 The student would discuss tlieinew 
site with his learnix^ coordinator 



i 

he would d^scviss the new site withf 



or 



the 



^Operations. Director* 



. . . • a; 

2^ Thje ^fcudept would t3ry to develop ^. ' 

the site himself. V 

■- . ' 

12 The_*ataff ^ would try to develop the ' 
site* and, if J)ossible, place the student 



"there as soon as possible. 

Question 6; How successful are Career Education Workshops? 

a. Data Sources: Students; random sample^ of 11 
' studerits 

b. Instruments: Questionnaire 

c. ' Administration Schedule: Septeirber; January 

d. Data: Students were asked to" respond to the following 

. ' V 
questions concerning the Career Education Workshop: 

^ 

(1) Did ^ou understand the information 
presented? 

September January ^ 

80% Afes 100%^ Yes , ^ 



(2) Was the information presented clearly? 
. September January 

79% Yes 100% Yes ^ 

— — r ■ ^ 

(3) ' Was the person that presented thepinfor- 



mation prepared? ' . - ' ' 

September January ^ 

7Q»> Yes ' 100% Yes ' ^ 

Question 7: Is the sequencing of orientation ;act:iyit;L.^^^.'.^5'ff ec 
tive? ^ , ^ ^ < 

a.' Data Sources: Students; random 'sample of 11 students 
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b. InstViaments: Questionnaire ' 'y t 

c* Administratidn Schedule: /Septeinber; January' . *\ 
d* Data; Students were asked to respond to the ' S 
following question: What specific changes ^ v, 

would you make' in orientation? 

(1) Reduce the amount 6f fre^j'time r 

^ (2) Reduce or spread the testing 

(3) Provide more information about * ^'^ 

procedures, rules, and regulations 

about the AEL/EBCE Program ' • 

*'(4) Th'reo students dndicated no ^ 

' ' changes are needed. 

« 

8. Question 8: Are time allocations for orientation activities 

'/ 

appropriate? 

ai. Data Sources: Students? random sample of 11 

students - -s 

b. Instruments : Questionnaire 

c. Administration S^chedule: September; January 

d. Data: The students were asked to respond to the 
following question: Are time allocations for 

^' ^ orientation activities, appropriate? 

(1) Too much free time 

(2) Too much testing in a short . ' 

* period of time " ^ . ■ 

, / (3) More time for explanation of 
*' activities and procedures 



^^tiestion 9: Are there activities which, should be added/ 
deleted? ^ ^ 

a. Data Sources: Learning coordinators ^ 

b. Instrximents : Questionnaire \ ^ 

c. Administration Schedule: January ^--^ 

d. Data: Learning coordinators were aske^J to respopji 
- -:^---t^t4Te foD.owing questionsj^ ^, ' 

(1) Should activit-r€s be acjded* to , , - 
pa?r^ntati6n?, , * * J ' - 

' * ^ 2* -Y'esj^^jj^-'lfo , 
"^"T2> - ^If yes , what activities?'' 

-ia) Better elsqifanatipn.of the 
y • learning coordinators' function 

(b) Better ex|)lanation of students' 
^ \ responsibilities 

(c) Explanation of Kuder results to 
Rt*udpnt/B 

((i) Kxplana^^ioh pf standardized teat 

results to students 
(e) Better explanation of the rules, 
regulations, and procedures, to 
Y V the students * 
^> (3) Should actlivities be deleted from orien- 
i . tati^oife 

'\ 1 Yes? £ No . y 
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nclusions " ♦* 

Learning coordinators do not feel they are given enough 

information to adequately complete the Progi^am Prof il'e > 

The -types of information typically lacking are transcripts, 

diagnostic test results, interaction with students, arid 

* « 

the students' aptitudes and abilities. In addition, *'fhe 
learning coordinators indicated more information aboulj 
courses and gburse descriptions would be,Selpful. . 
Learning coordinators find the Program Profile helpful in 
filling out the ^ Program Descriptor . If the appropr\a^y6j|^ j 
materials were given to the learning coordinators, when^ ^ ... 
they are filling out the Program Profile ; no additional 
materials would be needed for the Prograun Descriptor . All 
respondents indicated that no change, is needed in thp format 
of the Program Descriptor . 

To date, one student has returned to his home high school 
during orientation, < The AEL/EBCE staff indicated the 
student had difficulty in filling out forms^ at^ taking 
tests. 

Students, in responding to the .question concerning informa 
tion needed to complete the Program Descriptor , were very 
strong in stating -that achievement test scores were not 
needed but that general ability information was. Students 
were undecided in regard to the need for transcripts.- In 
addition,, students indicated information concerning their 
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interests, needs, and activities should be included on 
the Program Descriptor , 

Students that responded to a questionnaire indicated not 

enough information was given during orientation concerning 

experience site placements. Students requested information 

about' what happens at the various sites. The majority of 

the students indicated they would not choose the same site 

again. All reasons given, did not relate to the lack of 

information about the sites. Some students indicated that 

because of their placement, their interest areas changed, 
< f 

Students were positive in their x^eaction to AEL/EBCE staff 
willingness to develop new sites, . _ 

Students were positive concerning the Career Education 

Workshop held during the -orientations in Septen±)er and 

< 

January, 

Students indicated the orientation events should be 
changed. Their concerns focus on the amount of free time, 
testing, *and explanation of rules, regulations, and pro- 
cedureft which govern EBCE, 

Some of the^=0.ea^|ping coordinators indicated additional 
,»\ . 

activities bej^^dded to orientation. Their concerns centered 
It* 

on a better e^j^ianation of the learning coordinator's 
function, student responsibilities, and explanation of 
testing results. The learning coordinators did not indi- 
cate any orientation activities should be dej.eted. 
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11. Recommendations and Relevant Program Actions 

This part of the fonnative evaluation section lists the recom- 
mendations and relevant program actions. There is no implication 
that the formative evaluation recommendations caused program 
actions. The process is interactive in nature/'^in fact, the action 
taken by the staff may have preceded the initial recommendation by 



evaluation. 






Recommendations : 


ActionN. 


t. 

a. Learning coordinators should 


a.l. 


Realized by staff as a 


\ be provided with appropriate 




problem. 


:{ materials for filling out the 


a. 2. , 


Improve turn-around time 


Program -Profile. 

« 




on Kuder results. 




a. 3 . 


Provided learning coordi- 


• 




nators with transcripts 






fbr the second orientation. 


b. A description -of^ courses 


b.l. 


Provide Staibilization 


offered by each high s^Hool 




Management Team with ^ * 


should be provided to learn- 




information . 


ing coordinators. 


b.2. 


Document decisions. 


c. .Learning coordinators should 


c.l . 


Provide Stabilization 


J 

be, provided with information 




Management Team with 


deemed important by student 




information. » 


^ if the learning coordinators. 


C.2. 


Docxament decisions. 


s see it as important. 
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Recommendations ; 



Action: 



d. Students shoul'd be provided, 
• additional information about 

various experience sites. 

e. T^e staff of AEL/EBCE should 
re-examine the events, time- 
lines, and purposes of orien- 
tation activities. 



d.'l, 



Provide Stabilization 
Management Team with 
information. 

d. 2. Document decisions. 

e. l. Recognized that^ changes in 
orientation were necessary* 

e,2. Changed the schedule for 

orientation after each orte, 
based on staff and evalua- 
tion input. 
e.3. Providing Stabilization 

Management Team with orien- 
tation results so that 
decisions can be made. 
e.4. Document decisions. 

Subsystem: Ir;s tructional Delivery (Instruction) 
1. Question 1: Can learning coordinators tranl"late information 
from Program Descriptors into relevant learning experiences? 

a. Data Sources: Learning coordinators ' 

b . Instruments : Interview 

c. Administration Schedule: January 

d. Data: The learning coordinators responded to the 
following questions: 

(1) Do you have any problems' in developing ' 
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learning experience§...-b^ed on the • 
Program Descriptors? 
res ; 2^ No 

(2) If Yes , what prol^lems did yx^u encounter? "^J 

(a) Assessing information relating 
to objectives is sometijrias 

difficult. 

\ 

(b) Students ' program requirements 
often do not relate to students'* 
interest areas. ^ 

(c) Lack of sufficient in-house 
resources, v t 

(d) Lack of learninCf V^ordinator 
experfeise in a speciE^c program 
area. 
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(.Question Ccin learning experionc<W ho c<>lT\>tod with avail- 
K\h\o r «'^;(>irr civ; (i n-house, communi^y, of nxpcr i c^iksx; sites)? OH 
Do resources determine the nature of learning experrqnces 
specified? ^ 

a. Data Sources: Learning coordinator^; students 

b. Instriamcnts : Questionnaire 

c. Administration Schedu^: January 

d. Data: 

(1) ^ Learning ,coordinators were asked the 
following questions: 
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(a) What other considerations besides 
the Program Descriptor are 
involved^'in developing a learning 

« experience? ^ 
pe of products students 
{want to produce 
ii. Limitations and availability 
of in-house resources 
iii. Students' outside interests 
and graduation requirements 
iv. Overuse of some experience 

sites, resulting in some stu- 
dents having to wait six to 
eight weeks before they can 
be placed injthe site they 
' chose. 

(b) Do you have ariy probl^ because the 
fippropriate instructional materials 
(people or things) are not readily 
available? 

5i Yes; 0 No 

(c) If yes , what suggestions can you make? (/ 

\ ' V' 

i. More in-house resources acquired 

ii. Multiple listing of in-house 

resources #^==^ 
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iii. Better physical accessibility 

'. 

for finding materials 
iv. An up-to-date in-house 

resource list * 
(2) Students were asked the following questions: 

(a) Have you ever been unable to c^o 
certain learning activities you 
wore interested ,dn because the 
resources were not available in 
EBCE? 

6 Yes; 1 No 

(b) If yes / whajt problems were encountered? 
i. The books that were needed 

were not available or were i - , 
previously checjced out. : 
ii. Only a few available experience 
sites in'Charlcston for pur- 
suing a career such a?; \ictinn 
, or directiiig. 

3. Question 3: Are activities specified and products expected 
clear and unarnbiguous to students? ^ 
Data Sources : Students 
[nstrumcnts : Questionnaire 



b. ir 



c. Achni^iistration Sch^ule: January 

d. ^ Data: Students were asked to resp^d to the 

following questions: / 
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(1) when your learning coordinator gives 

you an Activity Sheet, do you (always, * 
usually, sometimes, or almost never) 
understand the purpose of the activity? 
£ Always ; • 5^ Usually; 2^ Sometimes 

(2) Is what y6u are supposed to do (always, ' 
usually, sometimes or almost never)^ 
clear to you? 

• ' 2 Always; £ Usually^ 2 Soffl^times 
^ (3) Do you (alw|»s, usually, sometimes, or 
almost "neTj^Bp know what products you 
are ^plppose'd to produce in completing 
an activity? ' 
; 3^jklways; 2^ Usually; 6^ Sometimes 



4, Question 4^: Do students know evaluative criteria and proce- 
dures when they underted^e an activity? 
a • DaBfe ■ Sources : Students 



4 



b. 



1 - 

c. Administration Schedule: February 



In^tqumonts : Questionnaire 



Data: Stydents were asked to respond to the 
following questions: » 
^fl) Do you know how good a job you have 
to do in order to receiye a good 



evaluation? 
3 



ays ; 7 Usuj 



lally;. 1 Sometimes 
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(2) Do you think the standards used to — 

judge your work are fair? \ 
^5. Always; 2^ Usually; £ Sometimes ^ - ^ 

Qt^estion 5: Are there objectives and clearly specified cri- 
teria for determining the potential credit value of activities?/ 
Is the mechanism useful? r^' 



a. Data Sources Learning coordinators; in-ly5use 



documents 



b. Instruments : Interview 

Administration Schedule: January 
d. Data: the learning coorciinators were asked to 

respond to the following questions : 

(1) Are you aware of any guidelines for 
deciding the ^point value of aa. 
activity? 
2 Yes; 2 

(2) If yes , how useful are they?/If no, 
do' you think.such guidelines would be 
useful? 

(a) The guidelines point ^ut 
some criteria ~ mostrly common 
sense, ^ ; 

(b) Yes, guidelines would be useful. 

(c) Yes I would be us.eful but »thay 
should be lievfelop'ed by the 
learning coordinators. 



{ 
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(d) 'No, guidelines would not be 

9 

useful since each student varies^ 
(3) Can you describe the criteria you now use? 

(a) Amount of time student will 
need to complete an activity 

(b) The amount' of credit students 
^ * need 

(c) How the Activity Sheet compares 
with iiigh school assignments 

, ' (dy Quality of materials student 
must cover 

(e) Quality of the product student 
must produce 

(f) A student's id^a on what a point 
" ' range should be 

(9) The, student 's needs, abilities, 

and past performanco 
(li) 'Vho cimount of time ^\ studf>nt 

has °in the ^program 
(i) The degree of difficulty o|f 
the Activity Sheet \| 
(j) The amount of Activity Sheets 
that can be written in that ' 
qiven time 



I 



Question G.-^Are criteri'a for assigning actual' credit valu 
b^nsed'on the ..cv,aluation, cle^r and unambiguous? ^■ 



ISO 



a» Data Sources : ^ Lecfrning coordinators 
b» Instruments: Intervi€|w 

c. 'Administration Schedule': January 

d. Data; The learning coordinators were asked to 
respond to the following questions :^ 



(1) Are there specific criteria for , , • . ' ^ ^ • 

- y ' .. ■ 
judging the adequacy of a' student^ s ' 



performance? 
^ 2 Yes; 3 No 



f. . * > (f), Accuracy \ 

(g) Dependabi^Iity 




r 



Siudent*3 abdijity 
'(i) Row well tKe subject area 
was cove2;pdt i.e., coritent^ 
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yes f describe the criteria and' 

• . y • ^ ' 

procedures you use in deciding j^p^ / 

much credit a complete activity shall • 

^ . ' ' \ ' 

— receive*' ' <> ^ * / 

(a) Effort of student , . • . ' * 

(b) Quality of work ' 1 ^* * 

(c) Quantity of woi;k . " ^ , ^ ' 

(d) Student restriction or * ' ' * ,* 
oxpnfision of the Activity " * * ' • 
Sheet . s , ^ ' ^ 

• - » • \ » , ^ 

(e) The time spent on the * 

_ . / ' - ' ;• ■ . 

product ' • , ' • 



(j) Creativeness 

(k) SeLf^directiveness 



!JoncTusiQi^^^ o ^ 

K majority of the learning coordinators indicarfea they had 
problems in developing learning experiences based, o/i the 
Program Descriptors ^ The problems centered around students 
interests and credits- needed for graduation, lack of suf- 
ficient in-housc resources, and lack of learning coordi- . 
nators* expertise in specific areas. 

Learning coordinators indicated that considerations other 
than the Program Descriptor are involved in developing a 

' I - 

learning experience for the student • The other consider- 
ations were products, availability of in-house resources, 

/ 

students* interests, anQ the use pf experience sites. 

All learning coordinators indicated problems existed since 

^ . instructional materials were not readily available, ^The * 

liNuniiuj coordinators suggested a number of changes:.' 

a('(|uirt> iiK>ro in-houso resources, better accessibility and 

multiple listing of in-hduse resources^ 

. A majority of the students had problems doing certain 

activities becfaus'e resources were not available, ^tudjj&nts* 

responses centered around the need for more books and Hihe 
I - 

\ 

lack of specific^sites located in Charleston that could be 



ggen toTstudents— duriiig_yi^^ of 8:30 a.m. to 3:30 p.m. 



such as sites relating to the arts. 
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d. Students usually Understood the purpose of the activity 
assigned tb t-hem by their learning-; coordinator , and /the 
directions I for completing the activity were clear. A 
majority of\ students indicated thc(t- sometimes tl^ey under- 
stood the e:toected product* Students usually understood 

\ * r-* 

the criteria W which their products were judged, * 
A major^^ of t^e learning coordinators were not aware 
of guidelines for "deciding the point value of an activity.. 
In most cases the learning coordinators agreed that gui'der . 
lines would be helpful. Mpst learning coordinators were r 
not aware of existing guidelines for assigning credit values* 



8. Recommendations and Relevant Program Actions 

\TKis part of the formative evaluation section lists the x^Qm- 
mendations and relevant program actions. There is no implication 



that the formative evaluation recommendations caused program 



actions. The proco.sr. is interactive in n^vture; in f^act, the action 



:aM(Mi by Mh* :;t a 



If may have preceded\lhc ini;1fjal rocommondation by 



evaluation. 



Recommendations : 



a. Learning coordinators should 
be prcfvided with «the vehicles 
^for developing appropriate 
.learning experiences. 
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a.l. f^^jcei'v^dtr.-a^, a t&roblem in 



.2. Deyelbped Vtoc^ 



i^elbped Procifedural 
Manual 'for using- forms. 
,a.3-. Assigned a person to 

manage the Learning Labr 

resources "coordinator hired 
in March ^ 1974. 



Recbiranendations : 



Action: 



b. Guideline^ should be / 



developed for assigning 

- •■■•■/. 

point value and credi^., 

I 



I 
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c. Communication between 

\ /' 

learning coordinators and 

students in the areas of 

^^■(1) purpose Qg/ ^Kctiyj-by 

Sheets , (2) .^products expected, 
I 

and (3) unc^ferstanding the 

♦ ' ' 1 ^ 

*• evaluative- criteria should be 

• f strengthened. 



' a,4, *Held in-service training 
for total staff, # 
a, 5, Conducted a mini^jstudy on 
instructional material 
usage • . \ 

a. 6, Providing Stabilization 
Maja|agement Team with 
additional data. 

a, 7. Document decisions. 

b. L/ Recognized as a problem 

. in October, 1973. , 
b.2. 'Conducting a credit trans- 
lation study during March 
1974. • 

b*3. Provide results to Stabilj 
zation Management Team. 

b, 4. Documenjb decisions/" 

c. l'. Provide Stabilization 

Management Team with 
appropriate data, ^ 
c.2i Document decisions.' 



Subsystem: Instructional Delivery (Other Issues) 

1. Question 1: Who ^i^ resp6nsible for updating the Program' Profile 
and Program Descriptor ?/Staff time?/Necessary information ■ 
available from forms? 

a. Data Sources: Learning coordinators 

b. Instruments: Questionnaire 

c. Administration .Schedule: January 

d. Data: T-^arning. coordinators were asked the following \ 

/ 

* * I 

questions : 

(1) How frequently do you review and update 
'the' students* Progrcim Profiles? 

1_ ' Once every semester unless students' 
interests change; 2^ Once every month; 
2 * Once every nine weeks 

(2) What informatioii„dp__you use _to^xip_dat_e__ __ ^ _ 

the Profiles? ^ ^ ^ 

4_ Transcripts; 2_ Test scores; 
4 Student expressed interests; 
4^ 'Pr^evious activities ; !_ Ufi-dated 
information on student recatds^ 



(3) Is there any information you do not have 
tY\at you would find useful in updating ' 
the Program Profile? 
2 Yes;* 3 No 



I 
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< (4) Mow frequently do you prepare new 
Program Desfcriptors for a student? 
1^ Once a Semester; Every nine 

weeks; 1_ lonly once; 1^ Once or 

I"' 

twice a sefmester 

(5) What jin formation do you use in 
updating the Descriptor? ^ 
2 Transcripts^ 5^ Program 

Prof if es; _5 Student input; 
4^ Records of students; Other 
(Previous Activity Sheets and 
student interests ) ^ n 

(6) Is there any ")inforraatiori *yt>u, do not; 
have that^yo^ would find useful in 



updating th efflescriptor? ^ 
2 Yes; _2 ' ~ , • 

(7) If y^P3, wli.it infbrm^tion is nnoded?, 

(a) A* vuiidpind cbmprelvonsive 

' 'f ' ■ ••■ 

; set of ^ncepts .and 6fejec-\ 

' i * - « * 

tives fdr aitpdentSv to ,pick 

from ! » 

(b) Rcspurces ^ • . 
' '(c) .Transcripts 

(d) Catalogue* c^f courses from . * 
*thc* tradiliionaKhigh school 




2. Question 2: What are the reasons for leaving the AEL/EBCE 
Program? • ;^ - ^ 

a. Data Sources: Students 

f ' 

b. Instruments: Questionnaire 

c. Administration Schedule: Whenever a student leaves 
the program. 

d. Data: Fleven students of ninery-five have returned 

< V , 

to their home high schools Bince S^sp^ember, 1973 for 
the following reasons: 
- " , (1) Schedule^ ccyiflicts (sports and jobs) (2) 

(2) Part-time job because of site placement (2) 
dissatisfied and transportation (2) 
^ (4) Transportation (1) 
. (5)* Unwilling to fill out necessary forms (1) 

:j ^ (6) Program incomplete for student's needs (1) 
^ <. ' (7) Dan't know and beyond our control (2) * * 

f" ' ' 

3. QpQStion 3: a. How are learning coordinators recruited? 

. ^ ' 'v-s 

->,«b.- What arQ/should be their qualifications? c. Training- 

for^role? d. What i^"" their role, duties and responsibilities?. 

^. Dad^ Sources: Learning coordinators; Design staff 

h. ' Instruments : Questionnaire 

c. Administration Schedule: December; January 

^ d. ' DaTta: , a 

(1) The learning (Coordinators were asked to 
respond to the following questions: 
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What are/should be learnipg 
cpordinators ' qualifications? 

Yes No 

, t 

^3 2 Philosophy, nature and 

operation of EBCE Program 

4 1 Role of experience sites 

in EBCE « 

4 1 Purpose, relationships and 

use of the various forins 
used in planning and moni- 
toring students 

1 4 Developing appropriate 

sequences of , activities 
and individualized instruc- 

I tion ^ 

>« 

1 4 Evaluating students* pro- 

gress and Individunl izod 
instruct i on 

1 ^'4 Writing behavioral objec- 
tives* 

Based on the previous six items, 
indicate what training you think 
learning coordinators should have,^ 
5^ All'items are .necessary 
Estimate the total number of hours 
of training you received in 
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preparation for your duties as a 
learning coordinator. 



i. Average" number of hours / 
33.2 

ii. Range of no hours to 80 
hours 

(d) Did you receive any other training 
to prepare you to be a learning ' , 
coordinator? (Not given by AEL/EBCE) 

*(e) What kind of training do you think 

a new learning coordinator should 

receive?/Indicate topics to be 

covered and give a rough estimate 

of the amount of time you think 

would be appropriate, 

i. Learning Coordinator One: ^ 
Plus observation of a 

learning coordinator in 
action and supervised inter- 
action with students. Total 
time needed is two weeks. 

ii. Learning Coordinator Two; 
y Individualized education, 

^ iEilling out forms and pro- 
qraxti logistics, supervised 
internship, and experience 



site relations. Total time 
needed is three weeks. 

iii. Learning Coordinator Three: i 

Guidelines for assigning points 

* 

and credit, overview in the area 
^ * ' - of the learning coordinator task, 
' . ' ^ the purpose of EBCE^^ writing 

Activity Sheets, cipd overview in * 
the areas on noh-exper-tise, fill- 
ing out Program descriptors and 
^ Profiles , and looking at thie role ' 
4 n of experience sites. ' Total time 



''•needed is appr6ximately three days, 
iv. .Learning Coordinator Four: 
* The philosophy, nature and oper- 

atiCn of EBCE, the role of exper- 
ience sites, purpose 'alid relation- 
ship of the various forms , devel- 
c)ping an appropriate s(X|uonce for 
• ^ <.'valuatlnq student products, the 
h.isic phildsophios aiui qotils of 
^ EBCE, and assigning new learning 

coordinators to work closely with 
those who have experience. Total 

i 

time needed is approximately two 
days . - • ^ 

\2) The Design staff w^s asked to respond to the 

following questions: 
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(a) . How were learning coordinators 

recruited and what was the popula- 
• tion from which they wfere obtained? 
Recent' college graduates and those 
with secondary teaching experience. 

(b) What are essential or desirable 
qualifications of learning coordi- 
nators? 

i. Competencies in all areas 

ii. College degree, not 

necessarily in e<}ucation 

iii. Strong social science 

background with minors in 
English and basib coun- 
seling and guidance 

(c) What previous experience would be 

t 

os.sontial or desireible? 
ft 

^ i: One or two years exper-\ 
ience at th^ secondary 



level, preferably in an , ' j.? 



innovative/exper^t^lental \ 
school 

ii. Some previous community 

experience, such as yolan- 
teer activities at churches, 
colleges , the arts, sports, 
id community counseling 
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What personal ,characteristic&? 

i. Warm, Understanding, atten- 
tion to small duties , and 
oriented to people 

ii. Outgoing, articulate , tena- 
cious , ability to relate 
* well to kids And employers, 
and commitment to what they 
are asked to do - 

ii/' Learning coordinators should 
be flexible, outgoing, like 
meeting new people, enjoy 
new situations , ^and be highly 
verbal 

After a learning coordinator is hired, 
what kind of training' does he or she 
receive? i. 

The major training emphasis is aimed^ 
at' explaining the system and how it is • 
supposed to operate; emphasis has been 
placed on how one does a^job^^d not 
on why it is necessary for a job to be 
"done a certain way. On-the-job train- 
ing yith periodic formal in-service 
traininj^ sessions basically is' a sink- , 
or^slvifn^.procfiss in a changing situation. 



(f) What kind of training should new 
learning cootdinat^s have? 

/ 
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i.j^ There must be training 
in new areas of exper--^ 
tise; for instance, irS 
learning coordinators 
are communication spec- 
ialists, then math, sci- 
ence, human- growth and 
development, individual 
differences,, etc. shotild 

be^ stressed in their 

v.; 

. training, 
ii. The learning coordinators 
need to know why they need^ 
to do certain things; for^ 
oxamplo, thoy *npnd to know 
liow to (Jr(^ns wh**M cjoinfi 
to an employer, how to 
treat employers, how to- 
recp.gnize the value of thb 
'"'^ program to employers and 
how to speak clearly to 
employers • 
iii. Learning coordinators 

should know how to use the 



i 
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system; more important is 
that the learning coordi- 
nators need to conform to 
certain behaviors for the* 
good of the grog;i:am, such 
as the dress code. 
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Question 3: What is the ro^e *of..the learning coordinator? 

a. Data Sources: Operation staff 

b. ' Instrument^: Questionnaire 



i 
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c. Administration /Schedule: Novembers 

d. Data: \The following ten task statements re^i^ct 

. the-^ole^^ and duties of the learning coordinators, 
(1) *Learnirt^ coordinators orient new students 
to the intent and workings of the EBCE 
Program in prder" to inform and prepare stur; 
dents for entry into E3CE. They use descrip- 
tive program materials presented in large 
group meetings and individual conferences 
^ with students- The orientation must be com- 
prehensive and accurate and> accomplished 
{ ^ within a predetermined schedule using. pre- '4 

* pared materials^ Learning coordinators use 
' their discretion on style and method of 
presenting orientation* * 
V ** ^2) Learning coo^-dinators develop and maintain 

a Program Profile for each assigned student - 
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to provide a cumtilative record and"*a 
description of the.student.' s academic ^' . 
i^eeds^and intere^s in order to build ' ^ 
the student's progr^. They use .small , 
group and individ\\al conferences, to ^ ^y. 
record information from student's high 
schbol r^brds f achievement test scores 
and fotitiali-zed interview data. ,F6rmat an^i ^ 
maintenance of PtoFiles are "prescribecf, ^ 
byt method of interview**is discretiQriary . * "^^ . 

Learning cobrdinatoi;^, develop and maintain , 

«* "J 

i' „ _ « 

a Prpgram Descriptor for each' ass^igned^ 
— rf-^-^ ^ ^ » 

student to provide arid track specific infor-^ 

'' 

mation regarding the student's acadeniic pro- 
^'gram ahd career placements. ,They us'e ,pre- - 
pared forms and have conferences twith^th 
s^tudontvto obtain the needed information. 




P^ormat oHBmiu^Rte nance 6l tho D^^cript^or ^ ^ 

are prescribed, but conferences .vary ^act:ord-^^ 
ing to individual coordinator -s-tylei 
Learning coordinators monitor 'academic/ ^ 
> career experienced for assigned'students to 
main-tain a personalized and comprehensiVe 
program of learning forv. each* sj:udent#^ .They 
use Cross Reference Catalogue ; Program 



as 



Prof i lo , Program Descriptor , related Activity 
Sheets, and Site Visit Pfeport ' form to assure 
that a student's program maintains a^hig h^ JLevQl 
logical consistency and releyj(fce. They 



use discretion on the emphasisrStnd timing of 
using thfe yarious '^docuraen'tfe - and techniques 
for mcni'torin'g students*' programs. 
(5) Learning coordinator^ access assigned students 
to academic/cafeer^ experiences for the f)urpose 
of }iroviding relevant and mot^vatinq loirning 
experiences related ^to their identified inter- 
ests and neejisj. They use_^ students ;I?rogram 
Profiles- , Program Descriptors , Activity Sheets,' 
and the Cross Reference ;Catalog system accord- ^ 
ing to specified instructions but us'e| some 
discretion *on techniques^ to develop "Activity , 
Slicots that help a studj^n^meot hi's • q.djneral and 



iK^cds to be con:^^i :;l(^nt w i fJi« ^M^fjdr^nt ' *V 

'\<r\ ■ 

rroqram Profile and Prognqm t)cscript{3^ .'\ 
(6) Learning coordinators coat<?(^t*'. and visit, ;^per~ 
ionce sites for the purpose;<S)f \placing/<sYuV 
dents, monitoring student's* development /?• main- 

A V ^ \\\ 

taining coromuni cat ions and good-Y^l^tioris wi\j}^ 
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experience sites and resource .pers^ons . Th6y' \ 



use Experience Site Leaning Guided ' arid Explor- ^\V 



at ion Guides. c Coordinators exercfi^Sje, a 'high \ 
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degree of discretion on how', to conduct an 
experience site visit. ' 

(7) Learning coordinators request , secure and pro- 
vide special counseling for students to assist 
them in program and personal development and 
guidance problems* They use the Guidance 
Handbook and the Operational Guxde lines * They 
exorcises some discretion^ in determining appro- 
priate tcchrjiques and procedures for indivi- 
dual students. 

(8) Learning coordinator^h^p to solve student 
logistical problems, s>ich a6 arranging trans- 
portation with chauffeur in conjunction with — ^ 
students' other logistical needs. 

(9) Learning coordinators meet together at regu- 
lar intervals ta coordinate site placement 
aru4^dovolopment of studonts* programs. They 
^'•^^ ^^^^ ^^<'quG9t forms and Program Doscr iptors « 

(10) Learning coordinators make regular evaluations 
of student progress for assessment purposes, 
' providing appropriate information to students, 
parents, EBCJE and home schools. They use 
evaluation forms and students' Program Descriptor 
ahd Ai^tivity Sheets. They exerci-se discretionary 
consideration in evaluating students' goal 
setting and goal accomplishment in relation to 
students' program development. 



»^uestloi>^4: Is' an ^fficierit and effective information storage 
and cetViWal system available to learning coordinators to 
fulfill ti^eir responsibilities? v . . ^ ^ ' 

a. Data Sqiirces: In>-'house. materials ; learning \ / 

.. } ; 

coordinators - * V ' 

• « 

b. Instruments: Questionnaire . - 

c. Administration Schedule; January 

d. Data': r.oanj^nq coordinators were asked the 
following questions: " > 

(1) What arc the sources of information? - 
Sources of information arfe contained 
in Table 3-7. 

(2) How frequently dp you encounter diffi- , . 
culties? ; ' ' ' 
2 Often; £ • Occasiot>ally 

(3) Do you feel the^ various procedures ^nd 
(Uiti(>r. arr* adequately documontod jn the. 
oiH-riit'ioiuU Guidelines? | ^ - 
^ Yos; 2 No ■ / 

Ques,t;ion 5: What were studpit perceptions^ of experience , sites? 

a. *r)ata Sourc^ss: Students / * , ^ ^ 

[I . ^ ^ , 

b. Instruments: [ Quest ionriajLTe 

! ' ' J 

c. Administration Schedule.: • After every placement 



- TABLE 3-7 

' SOURCES OF INPORMATION FOR ^J^ARNING COORDINATORS 

Not at all ^ Very 



• ■ , 

* 4 

\%^ 

\ 


Helpful 
1 


2 . 


3 


4 


Helpful 
5 


Program Area Descriptors 








1 


4 


LearnijjQ Guides- 


.1 




2 


1 


1 


Iil-.Hpuse Guide tb Lab Materials 




1 




2 


2 














CoreV Activity Sheets 


* 

3 


1 






1 


Cross "Reference 'Ca*:talogue 








2 


4 




Data: Students were asked to respond. to the 
following quest^ions: - , -* 

(1) Was this one of the experience site3>. 
you had selected on the experience. r 
selection form filled out during 
orientation? ' - 

62%, Yes; 381 

(2) Estimate the percentage of time the 
experience resource person spent with 
you while you were at the site. 

4 0%; 14 1-25%; 6 2^50^/; 
17 51-75% ; 20 76-100% 
<3) My overall in^ression of the person 
I worked with mostly at the above 
i experience site is: (check the 
appropriate space) 

^^'^ Liked very much; 3_% No feeling; 
< 12%^ Liked some; 3% Disliked*some 
(4) I would describe the experience resouirce 
person as- (place one check in the appro- 
priate box); ' , 

(a) 50% Very helpful; 12% Little helpf 
" - ^^ch heXpful; 3% Not helpful 

17% Helpful; • • 
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Always available; 2% Seldom available 
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(c) 



(d) 



(e) 



28% Frequently available; 2% Never available 

23% Available 

'35% Very warm; 3% Cold 

39% Warm 
21% ? 



2% Very cold 



45% Very interested in me 
19% Much- interested., in me 



22% Interested in me 



9% Slightly interested in me 
.5% Not interested in me ' 



47% Very excited about his work 
45% Somewhat excited about his work 
11% ? 



3%'-. Somewhat uninterested in his work 



0% Did not like his Work 



J5) While at the experience site I was 'treated 

mostly like (choose one) • , * /( * 

21% A student; 62% An employee; 17% A guest 

(6) I found that while- I was at the experience . ^ 

site, I : " ^ ^ * 

20 t Observed mostly ^ 

39% - ^Pai^ticipated a great (Seal 

3t Loafed mpstly 

2% Studied mostly 

27% Observed and participated -about J^ually. 

•v ■ 

iei 
1 



f 



(7) If you were asked to grade the experience 
site, what letter grade would you assign? 
(Circle the- appropriate response,) 
51% Excellent; .1%' Poor 

Above average; 1% Very poor 

10% ' Average 

/ / 

(6) If yoa Were asked to grade the .experience . 
, resotirc.e person, what letter grade would 
you assign? (Check the appropriate response,) 
/ Excellent; 5% Poor ^' 

^ • — i ' — ■ ■ - ^' 

26% Above ,-average; 2% Very poor - " ' 



I 

6, 



/ / ,-12% 'vAverage - - 



Question 6: , %hat we^re employer perqSpt^gns of EBCE/s 
a* Data Sources^' Entoloyers " 

b. Instruments:' QUesj^onnaire ' ' 

c. Administration Schredule: After every-'^site 



tudents? 



• ■v 

i\\ iKiKi: 'I'lu- rmployera ^^oro askod to rofifjond tp* <r 



\ 
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.series of statements about students* personal 
\qualities, wojfk and perf or^iance^. - The scale was 
,a fiye-*point ^cale^ rjinging from^ Excellent to 



Poor. 



Excellent 



4^43 



Above 
' Avera^^e 

/ 17-39' ' 



.7' 



12.)rf8 
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" Beldw 
Average 



.69 



Poor , 



.04 



Conclusions y^j-'-' ^^^"'^ 

a. Learning coordinators^ vary^ in the frequeticy of updating 
the Progiram Profiles from once a semesfee'^f' to'once every 
iTKjnth, Even though there was agreemerft among^ the learning 
coordinatorr^^ncerning the information needed, learning- 
^ ,^ coordinate t:s varied from once every nine weeks to once a 
year in up'dating the Program Area Descriptors . Even.-fthji&gh 

; there .'Was agreement among the learning coordinators con- 

. - ' ■ 

cerning the infoirmation needed, the learning coordinators 

• .'5 

. ^indic^ted additional information is needed, such as a valid. 
' cpia comprehensive Sj^t of concepts ,jpmd objectives /for stu- 
dents to pick from, transcripts, and a catalogue, of cou^sres 
from'tr^'<iitional;schooJ.s, 



b. Students who returned to their home high schools indicated'^ 

-that the, major reasons- were] rxc?t ,<iue to the- program but -to 
. ^ eX^traneous reasons beyond 'the control o,f : the program;-^ 
- -Tiearninc^ coordinators wer^ in relative agreement ^but the , 

V , '<jtjf^tU/<.caLiom; of^liaaming coordinators." They wer^ in com- 
, '"t'pi'o'tfe, ^rxH^nont on,-^raj?n'ing needed, 'Ph^ learning coordina^^ 



'"- v if'^^j^ i^njijte^t^S the ^o^inlf^f . tin^i?'^ spent in training ranged 



' ' -. ■" ftrom no hours '^80 hoQf s vi^-t^~-an average of 33.2" hours 



'^' dr , Jhe Design staff *ra''f^Cat<S3l' gy^fetiifications of learning 



coordinator^ xould inoliid^^these,^' . college degree, not 



necessarily in educaftion; " general competency in all ar^as; 
. , . and strong social-scienSe backg|:t)Upd with minors in English 

- / *• 1.. ' ' - > vi f. V f ' Off , ' 



and basic counseling/ The Design staff /indicated two 

types of previous experience were ijjrpbrtant: some secon 

dary teaching (innovative or experimental school) and 

community experience.' The' Design staff was in partial; 

agreement concerning the personal characteristics of' 

learning coordinators, i 
< 

The learning coordinators* role* is classified- intd ten ^ 
task fStatements • These* statements, have been Verified by 
the learning coordinators. 




Learning coordinators were in par\sial^ agreement that 
Program Area Descriptorg , In^-House Guide to Laboiratory' 
Materials and the Cross - Reference Ccttaloguis Wer6 very 
important sources of inforThationI ' Learning coordinators 
did not reach a' consensus onJwl3eth^"r"/prbcedu2?es' and 
duties arev adequately ^'oc'um^nted 'in the Operational 
Guidelines . ' ' \ ' ' 

Studcntr> indicated a positive attitude toward their 
'oxporicrtco site placements. A miajority- of the students 
indicated that the resource person spends 5 percent 
to lOQ* percjent of hlfe , time v^ith them at the site, ' Whon^ 
students responded to the questionnaire th^y indicated 
82 percent of^the time that they liked the resource 
person very much. The students perceived themselves, 
as employees/ indicating they \had some han.ds^on 
experiences, at the site. Fifty-one percent of the 



• 1^ . ^ 
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students rated the experience sites as excellent. Fifty- 
five percent rated the resource persons as excellent, 
h. Employers rated students. who were placed at their sites 
above average in both personal qualities, and work and 
performance, qualities. 



8, Recommendations And Relevant Program Actions ^ 

This part of the formative evaluation section lists the recom- 
ipendations and relevant program actions. There is no implication 
that the formative evaluation recommendations Caused pro^gram 
actions. The prop^ss is interactive in nature; in fact, the action 



take^ the staff may' have preceded the initial recomme;idation by 
evaluation,' ' ^ 



Recommendations ; 



Action^: 



\ 



a. The timelines for updating the 
' Program Profile and the Progra^n 



' Area Descriptor should be 
examined, 
6, A training packet for ' ' 

learning coordinators should , 
be developed. It should f 
: "include pr^service, internship 
ahd in-service training. j ^ 



a,l,, Provide information to the 
Stabilization Management 
Team, 

a, 2, Document decision, 
^b,l, ' Realized there was a 



problem with in-service 
\ training, . 

bi>^._^ ^eve loped an in-serv|<je 

47 



,w^-^aining packet in decem* 



''^ riDer, 1973, 



.ecommendat ions : 



Action : 



1 I 



c, Inform^ition gtorage, a^d 
Retrieval Systiem, ^should be 
re-examined in light of 
the learning 'coordinators 
concerns . . ? . 

d. The procedures and dubies ' 
contained in the Operatronal 
Guidelines should be studied.- 




b*3... Provide information con- 
cerning preseryice 'anSi- 
internship papkets to»the • 
^Stabilization Management 
Team. * ■ 

b. 4. Dodumeht decisi'on*^ 

c. l. Provide information to the 
Stabili'zation Management 

^Team. ^ 



<r.2. Document decisions." 



d.l\ -.Conduct a study ^concerning 
the adequacy of the* 0£er- 
ational GuideXines .' 

'd^. Report findinga* to ^ 



jj--- ^ Stabiliza!t£bh":"Management 
'diV3V^-';Og;cuitient decisions-. ^ 



p$^cui 



VIII. USE op CAREER 



MATURITy^^^^^ EVALUATION - > 

']/^ EBCE students were^ administelTedche-Iekreer Maturity inventory in' . 
September, 1973, and a random 'sample (Of. ^r -EfeC^ . Students were adminis- ^ 
tored the instrument at th^. end of the firs^fc, *•^^:^^ester•. ^ * 

Scores were determined' for each student Oft'seach of;. the -following 



scales: Attitude Sxrale, Knowing V'ourself,. Knowing .About Jpbs 



choosing a Job, Looking Ahead, and What Should They Do. Different 
scores were calculated for each, student over all six scales. mean 
score was calculated for each of the six scales, and a t statistic 
was used to identify significant differences. 

A. Preliminary Findings 

v^. The. a^ialysis of data derived from the Attitude Scale indicated 

th^ group of students tested at the end of the semester experienced 

positive* growth when compared to the group tested in September. The 

differences between the groups were not significant at the .05 level.' 

The data ^for the >f ive Competency Scales indicated a negative trend 

when cofhparisons were made between the two groups. The scale, Knowing 
ft 

•j^out'Jobs, was the only comparison that was significant at the .05 

t ' ' 

^evel^(see Tcible 3-8). Since comparison group data were not available 
conclusions could not be drawn. 

B. Relatio/i To ^'ormative Evaluation 

The data did indicate possible* questions which should be addressed 
•|'h(>soui,uestions* wero fojrmative in nature. Xhe decision was made to 
us^e the midyear testing data from the fall for formative evaluatiofi 
information. The questions raised by the data were the following:, 

, - \ ' . • 

1. Is the program the major reason for the negative 
^ \ ' trerfd"' indicated by the Career Maturity Inventory? 

2. Do the obje'^tives and concepts for the AEL/EBCE 
• Program match the items^in the Career Maturity 

♦ Inventory? \ 



3,. Isv the Career Maturity Inventory a good instrument? 

177 



TABLE 3-8 ( 

RESULTS or CAREER MATURITY INVENTORY 
(BEGINNING OF YEAR SCORES VS. MID-^YEAR SCORES) 



Mean of 
individual 
Differences 
(n=21) 



Sd 



Attitude Scale 
Knov^ng Yourself 
Knowing About Jobs • 
Choosing a Job 
Looking Ahead 
What Should^ They Do 



1.48 

- -57 
-1.38 

- .62 

- .48 
-1.33 



5-57 
3.74 
2.30 
2.61 
3.69 
2.85 



1.19 

- ^68 
-2.68 
^1.06 

- \5B 
-2.09 



• 05 



V 
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C. Recommendations Concerning the Caureer Maturity Inventory- 

The recommendations and relevant program actions are as follows 



Recommendations ; 



Actions :^ 



.1. The progreun should fee examined 
' " in relation to ^e Competency 

Scales measured in the Career 

Maturity Inventoify. X 



3. 



The items in the Career 

[ 

Maturity Inventory should be 
examined in relation to 4:he 



objectiVfef of Jthe EBCE 



Program.. 
The technical structure of 
the Career Maturity Inventory 



should be examined. 



1. a. Provide information to' 

Stabilization Man'agemen^ 
Team. 

1 .b . Document' "decision . ^ - 

2 . a. Analyze items in terms bfj 

objectives; ^issigned to 
Evaluation? and Stabi-liza^ 
tion Management Team. 

2. b, Doqument decision.. 

3, a. Analyz^N:he structure pf 

the Career Maturity Inven-' 

• w 
tory. J . ^ • 

3.b. • Repoti;. findings. 
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; ^ I. INTRODUCTION 

This section provides an overview of the major findings, conclusions, 
and rinplicati|)nSi Contained in the sunjnative and formative sections of tAis 
report. Since this is an interim evaluation, report , svunmative findings ^ 
are inconclusive and most formative findings are incomplete. Both are ^ * / 
based on results of evaluation efforts only through February , i'5 73 . These 
results will be used for program development, revision, cind refirifement 
stemming from decisions made^b^ the Stabilization Manageaefht T^eam (SMT) for 
the remainder of t& fiscal year. Actions -taken by the ^Stabiliza.tion 

•V ; ■ " - • # ' ' ' ■ 

Management Team arq being documented and thFir effects on the ongoing 
AEL/BBCE Program will contintie to be e^il^il^^ed. 

' il. FINDINGS MD:C^C|t?Sj^QNs' " ' " 

^ . The'^major findings were assessed ^irf five bfejp .areas : (1) attitudes 
toward EBCE,\(2)' cojnparison pf stUdefit; 'groups, (3) communications," (4^ 
e\^lpta#ior(7iaa€rtBnen\:s, and (5)- certain elements of program operations. 
A. ' Attirtudefe Toward 1SBCE 



ca^ee 



jitivQ attltude/w&i?«^o^^;i^^ the concept pf "eXberien^e-^ast^^/ 1 /» 
\T education. JRM^ner^ participants of the AEIs/EBCE Pi^^ram. qracluafciti«i . X ' ' • 

^ - , ' . ; '.^ ; • ' ^ 

in 19 73, and. ^Isb experience site contact 3hd., resource persons exptessjfea/' ' / 'v' 
very 'positive, attitudes' tdNlflird thfe'program. Parents aritt' c'u3cr,eV^^^^t:ud^^ , ^ ' 
were • especially strong^in ^x^ressing positive atti6ude^ tQWard th^ E^E- '^/* < 

Program. ' - , * . ' ' 2- ' 'I' » / 

^ »^ . ■ ^ v.:-.* 

There ares several plausible . explanations t-of- thfr very p<5s>itive ^ /• ' ' 
attitudes of all groups'v'' TWb wilL.be considered.;. First, positive- attitudes * • 

. •■ •- ■ : ♦ ' • ^'^ . . - ' . . 



could' result frdm'the fact that the feBCE PrograJd i's meeting the career 

and educational 'expectatipns* of students, parent^, graduates, and employers. 

A Second expj^anation might be simply th^t' partrxcipation in an experimental 

^Ite.rnati^Ve educational program accounts for these positive attitudes,* 

/ ' ' ' ' ' / 

''Based oq' tlie/ number of groups tested, the difference in the composition 

of thqse groups, and the variety of information-gathering mie'thoS's use'd, 

Xt has 'been tentatively concluded that the positive opinions reflect genuine 

prpgr'am impact, -as ,woll as the "halo" associated with special treatment in 

-xresearch and development program. 
• # ♦ 

,B. Comparison of Student Groups 

■ - , ' ■ - * 

At the time of fall enrollment the AEL/EBCE students differed from 
the comparx'son groups in several specific ways. All findings are based 



on an initial, greening and analysis of high school records and pre-test 



restrlts ,;7The fallowing are the four majoT differences: - 

T^e EBCK students on .an average were absent from 
'•y y ^ichool .1 fir(Mtor aB«jant --of ?tjjne tlidn worn ;;fudonts 

iji cMlIu-r i\nnp*ir 1 :.ou qrouj). 'Hic .sUit i i < m I I y 



sitjnxlficanL diileroTrccs were* based on t-rLcst applied* 

■ ' . '.-■'") '^^ 

to attendance ratios.-' 

Thd> grade point ^average of EBCE^ students was lower ' 
than the average ef students 'in either^ of the 
comparisfon gr^ll^. ^ ' 

Analysis pf ffesults of the^'initial administration- of 
the-'C^eer Maturity InventdTry indicated that. EBCE 



students received significantly iower scores on yie * 
Attitude Scale and significantly lowers cores on one 
sub-scal'e, **Looking Ahead," of the Competence Test than 
either comparison group. The EBCE students' scores 
were significantly lower than the 12th grade random sampi^ 
on the Competence Test subscale, "Choosing a Job*'. ' 



4^ "Apalysis of results of the Educational Development 



Series Achievement Tests show. that JpCE students 
scored lower on the reading and math subscale than 



the students in either of the comparison groups, but 
the differences were not significant in Scheffe' ' 
analysis. ! ' ^ 

These comparison findings^ are leading tjie Stabilization/Evaluation 

Unit staff t^o gipnerate hypotheses and formulate a nvunber of potentially 

researchable questions : , 

1. Does.thjB AEL/EBCE Progreun attract "t^ose students who 
are dissatisfied with tradiiiional or existing educa- 
tional programs? ' ' 

2. Does the AEL/EBCE Progreuii; attract those students who ^ 
are considered in traditional or existing educs^tional ' TTj: 
programs as '*high risk clients'* (e.g* ^^^lojj, academic" 
achievers, potential dropouts, or poor attenders)? 

3. Does the AEL/EBCE Program attract stpdents who are 

^ if 

.genuinely interested in exploring careers? 

4. Does '"the AEL/EBC^ Program attract students who are c,^* 
self -motivating .and independent?' , • ; 



C. Communications \ ^ > 

It appears that communipation (i.el, .generation qf relevant infor- 
mation and feedback, of responses) between EBGE staff and employers t 
parents, and students needs iitprovemenW , This^^f inding emerges from 
the interactive daily experiences of Operatioiis 'st^f f , students, and 

^experience site personnel^ It is sufficiently supported by question- 

■* 

naire responses from all groups to warrant continued attention to its 
many facets by all KBCE staff,* and especially the Stabilization 
Management Team. 

One possible explanation for. this lack of communication is that 
products which necessarily facilitate interaction were not developed 
prior to December, 1973. For example, use of JS^erience Site Learning 
Guides pauses mandatory interaction between^)ti^||sBCE staff experience 



^ites, and students. Another explanat;Lon is that AEL/EBCE staff, have ^ 
not yet sAaf ficiently recognized the demand for extensive communications 
wit-h all groups. 

I). ,1 nnt rumeiits , , • * ^ ' ^ * 

It a^ipoars that tlio instruments being Qscd to ^assess the summativc 
hypotlYeses are independent in terms of the information which each 
el/icits. A factor analysis was used to determine the cimount of overlap 
between summative evaluation instruments. On the b^sis of the analysis^ 
the aggregated pre-test data clustered into eight factors, each factor 

Is ' . 

relating to'^ a specific instrument, ft can,* therefore, be concluded 
that, the number *of instruments used^ in testin^j cannot be reduced on the 
grounds of overl^i^p and roatindancy. 



E. Elements of Progreun Operation 

Certain elements of the AEL/eScB Program are now stable. 
It appears that the process for site analysis and the * 
f'— ^velopment of Experience Site '■Learning Guides can 
> ,be implemented successfully • ' 

2. It appears that the process which^^^been designed * 

to deliver instruction has stabilized. The instructional pro- 
ducts have not been yet evaluated, however^ 

3, Tt appears that; the process used fot the third 

recruitment can be used successfully. It has not 

> ^ " 

been fully evaluated, but preliminary data support 
this conclusion. 

■s, • 

. III. RECOMMENDATIONS AND RELEVANT PROGRAM ACTIONS 

This part of the formative evaluation section lists the recom-\ . 

mendations and relevant program actions. There is no implication that' 

I ^ ♦ " 

the formative evaluation recomm^endajtions caused program actions. The 

process . is. trtterartivo in nature? in fact, the action taken by the 

staff may have proccded the initial recommendation by evaluation. 

RecommeiTdations ; - " Actions; 



A., Attitudes toward EBCE should'" 


A.l. Do further ^testing on attitudes 


be re-examine^'To determine 


^toward EBCE. * 


if 'the |>ositive findings ^ 


.A. 2. Provide results of testing to 


""result from, experimental con- 


^ Stabilization Management Team 

f ' 4 


ditions or the program. 


for decisions on program devel- 




opmenti^ , v 



17? 



-jr<^ ■ ■ ■ " 



Recommendations ; 



Actions { 



B. A stud^? of existing differ- 
ences betweeri EBCE students 
and other comparison groups 
should be ro-examined when 
analyzing post-test results. 



Research questions about 
differences in student groups 
should be re-examined, ^ . 



I). Communication botweon AKL/ 
EBCE staff and all target 
groups should be re-examined. 



Additional analysis on aggre- 

« 

gate post-test data ghould l?e 

' ' • * 

.done to determine^ if instru- 

iq^nts remain mutually exclu- 
sive, i 



A, 3, Document decisions^' 



A,4, 



^valuate decisidn outq^me^.,^.^ 



B,l, Inform^Stabilization M&nager 



ment Team-of differences . 

between groups, • • ^ 
B.2, " Desi^R data strategy^ for 

post-test data. 
B.3,* Report findings to S,tabiliza- 

tion Management Team. - ^ 

B, 4, Report findings to NIEU. . 
^•l, Design^^valuation scheme 

for testing hypdth^ses associated 
with each question. 

C, 2. Report findings to Stabilization' 

Manaqement Team, 

D, l. Inform Stabilization Management 

Team of the problem pf/^communi- ' 
cation. " ' % 
'D.2. Design strategy to solve 

problem. ^ " 7 



[fat 



D.3. Evalpate solution(s^ to prob'lerii. 

Lyfeis 

cussed in suirtfhative. evaluation 



E»l. Repeat analysis strategy dis- ^ 



section. 



E.2./ Report findings. 




RecommqndatiQns : 



■fit*:. 



F, v^The. process rfot^ 'tielivering^ 



, instruction should be, ana-'/ 



lyzed^ on^^a 1::ontinupus basis, 



G', The products for delivy'ing 
instruction should be 
evaluated", ' ' . 



f/*!, Repo'rt findings of /anarlysis 
-to Stabilization Management/ 
' ' Teara^ 

(■7 ■ 

,F.?. Continue formative evaluation 



^ of processes, > 
F,3. Report additional findings 
to Stabilization Management 
^ Team, 
F.4, Document decision, 

F, 5, Evaluate decision gutcomes, 

G, l, Design product evaluation.^ 

scheme, 
G,2, Evaluate products, 
G'»3, Report findings 'O*^valu|ition 

to Stabilization Management 

G , 4 , Document- decisions , 

G,5', Kvaluate-clecision outcomes. 
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CHARLESTON. WEST VIRGINIA 25325 
304/344-8371 



December 17/ 1973 



The Experience-Based Career Education program (the name was change 
from EmployernBased to Kxi^erienco-Ba..od since you graduated)' is need 
of information about the status of your career since you graduated from 
the EBCE program. 



^ I have enclosed a set of questionnaires to be filled out and -returned 
to me in the ^ncl6sGd envelope. Everyone should complete the whitq-'ques- " ■ 
tionnaire fir^t. Question- number 10 will provide directions on who^ should . 
fall out the blue and tHe green questionnaire. If you feel either W is ' 
appropriate for you, please fill it ou\. We would appreciate it if l you ? 
would, r.eturn the enclosed questionnaires by January. 10, 1974. ■ •' 

Also, any addi-tional information you could give us pertaining to you 
and/or EBCE would be greatly appreciatefi. If there is any. £urther Informa- 
tion which we might furnish you, we will be glad to be of Assistance. 

Thank you for yoir cooperation and if you have the opportunity, please 
come and visit us atj^nytime at-the EBCE site. We'are very much interested^ 
m seteing you and T^^ding out vihat's happened to you , since EBCE graduation^ 

, Sincerely, , 



JHS/mjr 
Enclosures 



James H. .Sanders 

EBCK Evaluation Specialist 



NAME 



PRESENT ADDRESS 



PERMANENT ADDRESS 



1. Marital Status 



EBCE Graduate Ques*tionnaire 



DATE 

K 



SEX: M 



r 



Siij^le 

Erigaiged 

Married 

Married, Separated 

Divorced 

Other 



2. Hew- many ^iull time jobs have you had? 



None 

One 

Two 

Three ' ^ 
Four or More 



3. ^With whom do you live? 



Parents 

Relatives ' 

Priend(s) 

Alone 

Husband or Wife 
Other ' 



4. 



How often Kave you voted in a public election? 

* Not old enVmgh 

Once \ ^ - 

Twice 



• Jliree or more times 



5. Are yoi/ a volunteer worker for ,organiza,tions? 
Yes • ' 

No, but I'd like^'to • *^ ^ ^ 

^ ^ -* No " . - ' ' 



When you look back and c*bmpare the course of your car^^er s6 far 
with people about your age/ are you: (chfeck* one) . , ' 

much less satisfied wit]) your ^taroftr t^an they^^are? 

^ somewhat less , satisfied witJi your , career /than they 'are? 

about as satisfied with your career as tlley are? / 

somewhat more sdt5^sf led^with your o^jalxr; than they arh? 
Stuch more satisfied with your careci^^^n thay are? X ' 



Wh^n you compare how the rest of yo*^r 'caiieor ly Ukedy to turn out wi.th"* 
^'how the careers of people about^ your age afe' likely to turn out,i.are. 
you: (check one) * • " 



much less satisfied than .they* are? 

somewhat less satisfied? 

ab(JUt as satisfied? 

somewhat more^si^^tisf ied? 

much more satisfied than they^are? 



9 



The statements, below describe different types of c'arfe^r achievement: 
Please ciVcle the appropriate number to show how-, satisfied you are -with 
each of these career achievements.* ^ 

X Very 

Diss^tis 
id 



The certainty of my career goals 
•ft'he achievement of my. career 
goals. >K 
The overcoming o-f difficulties 
in my career. 

The path I 1>ave followed toward 
my career goals> 

The speed with which I have jnoved 
toward my career gfcals. 




Somewhat 
Dissat;is- 
fled ^ 



<' r 



^Spmewhat 
Satisfied 



'Very 
Satisfi 



ed 



1 
1 





4 




4 


3 


< * 






3 


4 











Th^e statements below are descriptive ofr-various w^ys in ^hich the EBQE 
Program you participated in may or may riot have assisted you^, -Please 
circle, the^ appropriate humber^to show how rfuch ajf fecf^ the. EBc/ Program 




on you , 



'Strongly?? ^' ' Strongly 

/ . s . ' Agree Agtee Disagree Dii>aq^^4 , 



EBCE helped pro[)are me for work 
^EBCE helped iTroparo .mo fol:- coHggo. 
KBCK* helped me buconuj a btjij^ttcr. ^ 
persofi. ^« 
EBCE helped me develop my mind. 
EBCE helped me in personal 
adjustment^. 



3 

^ 3 

3 




if 



T v> "*\S/v \<yyy^' Aj^ ^^^^ 

••• V, - V^V V- r^-/;., •: V". 





a. 



EBtE Graduate Eijigloyment Questionnaire 



' - ..... . . ^ ; ^ V' V. ^ , 

How .mony %ill-time Igb^^OQ- btr^ifjof o^h^^ p^o r , we4,>k*0 luVve y^U^^eld since you 
lelft the "EB'Cfi* program? V"^ '* ' '"^ ' * ' 



None 

full-time job- - ^ 
jobs " "^"^^ 
3 or more ^Rill-time jobs 



: \ 



2, HOW closely •di'd your first job^ after graduating relate. J:6 your RBCrJ .t)xperience 
(Check OFrfy one.) " , • * " - ^ 

( I employed in aa pecupation in whic/i T^^^^^^^xperiences'/ 

^ I was dmployod in a'^rolcited occupation^^^j^^^^T^'T^ ^' . - ^ 

^ I was empioyod in a compJetely diffj^s^^nt occupation, 



3, Did the KBCE program adequately p^^^xi re you Cor your first -job? 



yes 



^o 




,4. What was your beginn;.n9 hoWly 

$ll59 or less per hour 

' $1.60^to $1.9^ ^per hour' 

$2.00 to $2.49 j)er hour 

- $2.50 to $2.99 per ^hour 

$3,00 'to $3.99 per hour"" 

»$4.00 or more per hour 



wage on the firsf'-job you iiad- after graduation? 



How did you g^t your first job"^ after^leavlng the EBCE program? (Check one) * 



I got the job myso'lf. ^ / 

My famil^y or friends helro^^-^e get the job, 

The. EBCE program helnt-d^ie get. the job. 

An employment, acjoncy helped me 'got tho job. 

Other (specify), ^ > ^ 



6. What , is your present field -of work? . 



7.' V/hat is your present job ti^le?. 



7-- C y . What 13 the name of the company- you presently work fjor? 



9. '^^WJaaCris., your .present hoUrly ^^age? 



r 



r; '>^' ^i:-:;5.9. or less per hour 
51.99 per hour 

* ; '/V :-$2;ba.to $2..49 per hour' ^ , ^ * 

'^.'V-lv •$'2;Se>;to $2.99 per 'hour ' 

: ' 'S3 ^ 6.0' to $3.9S)^per hour . ' - * ^jh 

' $4,00' or. more per- hour v • /* 



IQ/ What is your main reason 'for //orking? 



. Support' self or family ' ,/ 

Experien ce ' , ^, . ^ 

To have a career ^ . » ' , i x ^ 

It's interesting ^ 
Other , 



I,- 



i 



■ 11. Would you like to work at your present job 5 years ^V^m now? 

, ^Definitely ^ /" 

/ 1 Ptobably y A' 

\ , Uncertain " ' ' ' . 

-i Probably not 

I " ^ Definitely not jjC ' 



y 

12. How many hours do you work a week (average)? '^'^^'f 

' , 1-4 hours ' '.'//t''/ 

5-10 hours ^ • ♦ ' i' -'/ ' 

11-20 hours ' * - 



23^30 hours ^' ' /f"' / , 

31-40 hours 



.over 40 hours _ 7/^ /^ 



•13,' How much difficulty did you'bave gettin^^wgirk? 
^No difficulty ' " 4/ 



Some difficulty • 

^ i^uch difficulty* *ij 

14. Would you rather have some other jol^/?/' 

yes no 

?mlf yes , what-'kind of job.woul^ you prefer? 



The. same kind .of work., but; for a different kind of employer 
A different kind of work. 



15 • Have there been any jobs you^ tirieQ for but didn't got? 



^^yes. 



If yes ,- why do you think y6u. did hot get tho job or jobs? 
'■ ^-^^ ^ 



16. 



BeJow are listod .somo items describing various aspects of iobs. Ploase 
circle for oacfi itom, tiio luuuber that best deHciiboh> how satisfied you are 
with thijj aspect of your ptObont job, ^ 

1 = Very dissatisfied . I 

2 = Fairly dissatisfied 

* ^3 = Neither satisfied nor dissatisfied 

4 '= Fairly satis fi(?d " ^ 

.5 = Very satisfied 
NA =? Not applicable , 



ERLC 



1 4^ 



a. Eafnings 



b. ' The duties of the job^ 

c . Job •securi ty j 

d. The' .Amount of responsibility I have 

e. ., Jhe amount of variety in my work 

f. ' The amount of prestige 1 have ■ ' 

■r ' u ' ' ^ ■ \ 

g. Jhe degrbe of difficulty of my work 

ti. .^he work yiioad ^ . ^ 

1. Opportunity' for promotion or 
advancement- 

benefits (insurance^^ sick pay", 
pension plans, etc.)* * ' ' ' 

k, Opi(^ortuni ties to use my initiative' 
X or judgment 

1, 0[>j\ort unities to use my knowledge^ 
* and abi li ty 



Very 
Dissat . 

1 

1 

1 

1 

1 : 
1 : 
1 : 

1 t 

1 : 



Very 
Sat. 



4 
'4 
4 
4 
4 



Not 
Applicab le 



NA 

NA 

NA 

NA 

NA 

NA 

NA 

NA> 

NA 



NA 



NA 



NA 



m. Opportunities t^ share interests with 
those in my" lin^ of work , • 

n* Getting along with follow workers 

) , . 

o. Getting along with those under me. 

p.- jGetting^ along with other people 
. I meet in my work \ 

q. The kind of suporvisor I have^: ^ 

» -« 

r. Opportunities to manage or supervTsc " 
other people and activities "7"^ 

s. The degree tO' which my job enables 
' ^ me to live the kind of life I -want 

t. .Opportunities to benefit others* 
through my work 



2 
2 
2 

2 
2 



3 
3 
3 

3 
3 



4« 

4 
4 

4 
4- 



5 
5 
5 

5' 
5 



NA 

NA 
NA 
NA 

NA 
NA 

NA< 

i 

NA 



,u* Physical working conditions 

^. Opportunities to b^ creative and 
inve'ntive 

' Opportunities to do a good, job 

X. ' My skill at work«ing wit'h people 



V 

t 

i, 



2 

2, 

2 
2 



3 

.3 



NA 
NA 




What- speci f i c thiiigs about the EBCK^ program havjr you fpund to bo tl^j^ most 

rful to you in your present job? ' ^ / > y 







« \ \ T 

/' ■ ' 


/■ • • ' 










Based on yo^r 


e^xperiences , 


what spgc^estions do/you have for improving the 


EBCE program? 




* * . / ' * 

^ " ; / ' ^ 
• , / / 








\ 
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. • • EBCE Post High School Training Questionnaire 

* 

What type of training program are you now participating in? (Check one) 

* » >, 

f_ 4-Year college or university # 

I , Junior or community college 

^ Vocational or technical school m 

Business school • 

^ Trade school ^ t r . 

_J Other (specify,) • 



What is the main training program you plan to complete? (Check one) 



Some col lege 

Junior or ^community college* 
VQcational or technical school 
Ttade or bu.sincG^^ school ^ , 
4-Year' coi:j.ege 

Master's D(tgre(e <or 5.-year program) 
Doctor^* s Degree* (or 7 year program) - 
Other (specify)\ ^ 



How much difficulty ^id- you have in getting \n the school? 
• Nqne Some A Great Deal 



If you marked Some or A Groat Deal , would you briefly explain. 



What is.yoi:^r main reason for going to school? (Chock one) 

^ I To pursue a chosen career 

^^To find a career 

Could not find work*-™* 

Did. not know what else to do 

Parent or friends pressure 

Other (specify) . 



How well did ^ the EBCE program prepare you for your training program? 
/ . ' . 

Very '^helpful 

Somewhat helpful ^ 

Not helpful^ ' ' 

What car;e^r area are you .now pursuing? ' 

None . • * ' . / 

— —11. I, 

Specific*^ career (explain) . 



• 2 



1, What aspects of the EBCE program were particularly useful or heli)ful to you 
in your training program? 



8. What more would you have liked to have received from the EBCE program to better' 
^, assist you in your presen.^ traiqing program? , > 



re' ^ 



-t- 



1 



changes would you recommend, b^^ made to improve the .EBCE program? 




. t V, 



AEL/JHS/12-15-73 
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Appendix A- 2 
Stfudent Opinion Survey 



r 



?01 



■■1 



ERLC ■ 



\ 



■ , ^ 



\ 



41 



Student Opinion Purvey 



. This survey \s maont to give you an opportunity to c>q?ress your opinions 
about the Career Education Program Vou have bcx^n ixirticipating in. Most 
of the questions ai*e to bo answered on a. scale of nunlbcifs frcinQ to(^' Tlie 
WDrds at the top and bottom of each set of quastions tell you \>*iat the numbers, 
inean. A0may mean sanething liXe' "Definitely *No"; if you feel yery strongly 
that the ansWer to the question is NO, then you sliould circle the@: A(S)may 

o 

n^an "Definitely Yes"; if you feel ver;^ strongly that the ansvger is* YES, 
then you*should circlo, theQ. The numbers in bobvccn {2,3,{i) nvean that your 
opinion is neither "Definitely No" nor "Definitely Yes" * but soneWiero between 
them. You should circle the nuntor thdt is ^closest to your real opinion .of 
what the question is asking alput. Soma scal6s have different words, but 
they always woyk tlie same. Read the words eibove and below the numbers so 
you-kncw v^at the numbers mean. Read the questions carefully, ard circle .the 
nunber v^ich is the closest to your opinion. There are no tig]xt or wrong 
answers; your thoughts and feelings -are the inportant things in this survey/ 



le answers students give will bemused to hplp.derarrriine how well the program 

is <dping hw and to iJTprov^ it in', the future. Remejnber to circle a nurnber> 

answer each item. If you have any questions' wliilo. you 're ccrpleting feHe sav- 
vey, just as'l'TEOT assistance. , : ' "-^ . 



PLEASE CIRCCE ONE NUMICT TOR EAQI QUESTION 



h. ' Have you liked attending the Career 
Education Program? 

• 2. If you had it to do over again, do you 
think you vvould decide to participate 
in the Careet Education Program? i 

3. Have the activities availaMe in the 
Career Education Program been interes-- 
ting to you? 

4. In ^ the Career Educatipn Program'; have 
you felt that you could progress at 
your own rate? 

5. ^ " Have ^yoxi seen much of a relatfionship ' 
betv^en your activities in the, learning- 
center and the careers you have learned 
about? % ^ 

'6. Do you get enough feedback about how 
. well you are doing in the program? 

7. Have you h^d enough choice in dec'iding 
the amount of time you spend at aiplqyer 
sites? } 

8. Have you had enougft choice in deciding 
the amount of tihie ypu spend in learning 

, acadesnic subjec|:s? • 

9. IMye yoj^ad ehaigh choice in deciding 
what yolijdo at cnployer/resourcc* sites? 

10. Have you hcid enoiScjh dioicc in selecting 
the types of orplSyer/resource sites^' 

^ you visit?^ \^ :j • ' \ ' 

11. Do nost people receive much satisfaction 
fjjon their work? , ' 

12/^ Do you think that if a person works 
l^~haxd enough, he can achieve anything? 



PLEASE anCLE CWE NUMBER FOR EAQI QUESTIOM 

A ' ■ ■ 



PLEASE CIRCLE ONE ^JUMESRR FOR EACH QUESTION . 



13. Do you think, that the nnin reason a 
perspn works to cam cnqagh money ' 
to live? ^ • * . 

14 • In general, are you looking forward to 
wrking in a job? 

15. Do you think you have much choice of 
occvpations? 

16. In general, were^ the enployer/resource 
personnel involved in the Career 
Eduction Program aware of ypur needs 
and interests? 

<r * <* 

17. In general, at emplpyer/rqsource sites 
did you get to actually do^ things, 
rather than just listen? 

18 1. In* general, have the enployer/resource. 
sites you've visited been interested 
in the Career Education Program? 

19. In general, have you felt welcome at ' 
the enployer/resource* sites? 

. ^ 

20. Do most of the 0Tployer/3?esouroe sites 
;you have wrjced wth let you know how 
you^'rQ progressing? 

21. * Through your ejq^erie'nces in the Cci^eer 

Education Program have .you learned ai lot 
about opportunities for tlie future? 

^- 1 ' - . 

22. Do you plan to get a secondary school * 
diploma? < : 

23. Vfould' you say ' the Career Education Program 
has helped you form career plans? 

24.. \tould you say you've learned a lot while* 
attending th(^ Career Education Program? ^ 



Definitely 
N<j) 



Definitely 
Yes'^ 



t 2^; 3 4: 



-r 



1 2 3 4 5 



1.2 3 4 5* 



1 2 3 4v 5 



1 2 3 4 ^ 



1 .2,-3 4 5 



1*2 3 4 5t 



1 .2-3 4 5 



1 2 3' 4 5 



1 2/3 4 



2 3 4 



1-2 3 4 5 • 



Defijutely' 
No 



Defiiriitely 



PIEASE CIRCLE ONE mmsk K)R EACH QUESTION 



r 



.^PLEASE CIRCLE 01^ NUMBER FOR EA^Il QUESTION 



25. How well orxjcinizcd afja\ coordinated 
do yoa'^think the Career Education • 
, Program has been?- ii?;a^v ^ ' 

\, 26. How would you rate ; the. genera 
' quality of the Carder Education ^ 

Program staff? . , ^ " • 

127. ' How would you rate the personal 
counseling availeible in the 
^ Career 'Education Program? « , 

28. How would. you fate the career 

counseling available, in the Career . 
Education Program? 

- '29. .Hc^ would you rate thei» general * . 
^ Equality of the Career Educaticai 
' ' • Program enp]oyer/for>OLlrccs you've 
worked v;ith? ^ 



Poor 



4-^ 



Excellent 
— 



1 . 2-. 3 4 
•1 2 .. 3 4 



.5 • 



K .3 



1 . 2 

; 



4 .5 



Poor 



/ Excfe^lcnt 



30* How ijiportant >as each of the-follcw- * 
ing factors in deciding to joirt the 
Caijfeer, Education Program? , * ^ 

i. . * ■ ' 

a.. -I wantedmore freedoiVindepen[dence 

' • b. \ I wante<^ tC^ choose my own ^Learning 
style . ^ 

• c; I w^ntQd. to leaxn 'cibout careers 

d. I didn't like my^ previous school 

e. I wanted to propca^e for a job* ' 

f. I waS'' bored with sclipbl^ 

g. . ; I heard the^ Career Educai'ton Program 
' was easy * ^ ' 

h. 'Otheif (specify) ^- ^ ' - 



Not at,, all,^ 
IhportentV 



JSSctrenely 
litportant 
• > ' 



1 ' 




3- 




5 


■ 1^ 


2 


3 




. jf • 
5 • . > 

« <» • 


.■■•1 ' 


» 

2 


3 






1 « 

/ ' ^ 


2 


3 




5 .; 




*2 


3 


. '4 ' 


'5 , '7 . 




2 . 


. 3 ' 


■■ 4 

«> 


5 


i ] 


.2 • 


.3' 

1* - 


' 4 





1 

Not Qt -alj 
Important 



\^ .3 4. ' 5- 

n ■ — . — ^-M- 



•Ektx(3W2ly-"' ; 

^'tSbrtanf 
i\ 



O EASE CIRCLE ONE. NUMDER FOR E?\CH QUESTION 

ERIC 



PIEASB CIRCLE ONE ^NUM&ill^ FOR EAQI QUESTION 



31. In conparispn with regular schoDls, 
how inucli oj^rtunity did the Career * 
Education Rrogram providQ^you f6r 
learning about occupations? 

52. In coiparison with regular schools, 
hew much opportunity did the Career 
pducation Program provide^, you .for 
general learning? ' 

33. -In comparison Mith past experiences in 
regular /schools, how ^rotivatpd are you 
to learn in th^ Career Education PrcH 
gram? 



Much 
Less 
f— 



-4- 



About 

the 
Same 
-^-1 



Mudi 



4 .5 



3 



5 

4- 



tluch About , Much 

Less . * ■ . the More 

« 

Samne 



34 During this sdiool- year have you worked outside of hone for money? 

a. □ No ' ' , • 

Ql Yes, less than lo hours a week 

c D Yes, between. 10 and 2D 'hourspa week ' * . 
« d. Q Yes, 'between 20 and 30 hours a week. . ' < 

e* D more than 30 hours a week , . / ' •« 

35. X'i you hayfe an outside joB", does It interfere with anything listed belcwgr';'\- 
•ci.- D * I don!t have an outside job ^ . . ' 

' b. LJ My job doesn't interfete with any other activities 

^ c. D It interferes v;ith my school work . 

' d. n It interfered with my social life. 

' * • ^ 

, e. Q It interferes with , my extracurricular activities ^ , 

36. What changes, if any, vJould you like to see in the. Career Fa,ucatioH{P^o^^ 



■r.-.r-/:/' 



37. 




students I<?a'rn -'tof . v \ ; 



PerJfornKV^PQciXic occupat}on1[d:^kHls • 
Be mjolctiKil and organii^e^'tJyeir tirhc' " 
c. Assurq^ responsibility- far '(ieiiisclvbs 



d* Malce decfsions* and follow Uii;^ug]i' 

pi 



Communicato v/ith "BUicij^^ in a 
malu'rc way ' ' \^ \ '^'^ - 

. ' -\ ■■ 

Be aware of more ear;ccrj: 
opportunities; - ' . - ' 

\V6rk.4vitljr otters ' 



E\;^utc their own-v^prk; - • 
ii ''^■^^^'/Pe^fo^m basic' aeademie skills 



J,// 'milik' .through. and. solve problems- . 
(Vu^ ^Have'^a positive attitude toward ^siclf 
r V / ^>n^iV^' a - positjX'e/attitudc 



tbwnrd work 



If if i 

t 



xtL, r jlave a pQ/it/ve.attitu(io toward > 

nil 'Prcpai-0' for , further cducatfLoiu 
y,oJ ^Improve injiffirpcrsbnarand social 



9 



Other '(piJeaxo spocily) ' i / 



' P: 



; Imporr/;/^ //? „' Inipcir 



1 
1 



a 



1 

1. 

1 



2" 
^2 
2 



3 
3 
3 



2 .8 



1/ 2 



4/ .5 
4 5 
4'; 5 



4 . , 5 



. i-. .2 3 4. :5.-.vf ' ^ \ ■' 1, 

: 1 t^l^l'U '5,.% i-; 2, 



. X 2 > 3\;^/ 5 
•■»< •"- f'] 

2 3 



4 ••'^ . 



9 v/- 



1' 2, 3 




/^i''^:;3'';^i?.<;;v 



V. 



1^ . '2 



AY' S 



2 
2 
2 
2 



3 
3 
3 
3 
"3 



r 



4.^ 5 
4 ; 5 



4. 5- i 

>-■'/.• ! 



1 2, .3 4.;- ;0 



*i * 
A * r 



4- 



5^' , 



3 4 

va/ .2f -3v>xV^''&';|^'>' 



/ 
■•f 



: u y V . . • 



• 7 




,i ■■■/-/■ z'^/- 



304/344-&37i:' ' 



FfSbruary 24, i'974 



V • 




has now participated in t)ie' EBCE program for ^over one seiies-ter. 
Although yo^ re.c<?iv(^d a 'simi/lar ques£ionnairc .atout six months ago, it 
^^.y^j extremely' irai>ortant that wo receive some additional information from 
'^J- '^j^/y?" concerning your thought., and attitudes toward the- KHCi: program. -Jhir. 
< r*^?^^"^ ^"^stiorma-ire will lx» used by similar i^rojccts throucjhout the count 
' 'V^^y^^ responses are ^thcrofore an^ important pant of national attempt to 
; ;^y^fuate the KRCE p'rojoct. , - * . ^ 



^ / - ■ - . 

v^;^^ your .response will bo carofully coded so^ that coiif idcntiality will be 
^V^^^^^^^^f^^^'"* Hohe 9f Ihc' t^achors or administrators of ' the DBCE program 
'-'.^iil.iSee ^biJ3r/>ciuestic)nnaire. Tlioy will see ,a ' summairy' report of all' the 
^•qlifei^tipnna^i^^ 9 ^ • ' ' ' 

. V 'V-'''''?^^/^*^" har^e arny questions or concerns about any o&, tjhe items, please 
. f e^A' con^a*el^me at 344-8371. , Please return the'-questionnaire in 
t^'';encle4ed/ert\re^^^ February 22. " . \,. - ^ ^ ' 

'J^^H,, .^/^^ taking your valuable time to assist us in evaluating 
and;.:^»pro\^il^^^ EI3Ct:-* program. _ • ' 



v> 



sincerely.. 



James- H. Sanders 
Evaluation SjK-ciaiist 



JMS/mjr 



V 



Enclosures ,,-t-<J-'"^ ' ' 
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/ • Parent Opinion Survey 

* ' . . ' . / ■ 

This* survey is meant to give you an, opportunity to express your 

opinions about the Career K^ucation Program your son orl daughter lias been 

participating in. Most of the questidns are to be ahswerod on a scale of 

numbers f rom (l) to (tTi The phrases at the top and bottom of each ^et of 

questions indicate what liie scale means. - A ir)may mean something like 

"Definitely No"; if you foel- strongly that' the answer to the ^juestion is 

No, then you should circle the (T) A (5) may mean "Definitely Yes"; if you 

feel strongly that Uie answer is yWk / thenv yoi;. should circre the (s) The 

numbers in between (2, 3, 4) indicate an opinion somewhere in between"^ 

"Definitely No" and "Definitely Yes". Som§ scales havp different phrases 

but they all work the same way. - 

i'-<^ Read the phrase above the numbers so you know what the scale "means, 
then read each question, find circle the number which is closest to your 
opinion.' ^There are no right or wrong answers; your thoughts and feelings 
are the important things 'in^.^this survey. . Tfie answers parents give will" 
help determine how well the program is doing now and improve it in the 

future. Remeniber tp circle a number for eacli item. Thank you for taking 

^; / . • ' ' ^ • '\ 

*the iiJtie to fill out this survey. 



Career Education Program 
• * Parent Opinion Survey ^ ^ 

How^'wel,! does the Career Education Program compare overall with theipast 
school experiences of your daughter or son? 

, ' - ' . ./ 

* Much Much 

/ I Worse , • Better - 



•If you had "it to do over again, would you want your son or daughter to 
participate in the Career Education Program? 



Definitely 
NO 



Definitely 
YES 



How well do you* think your son or daughter likes the Career Education 
Program compared With past school experiences? 



Much ' 
Worse 



Much 
Better 



3 ' 



What do you think are the greatest weaknesses of the Career Education 
* Progreun? * 



* 

■ • ■ -■ \ 


'— — 4 


v 

\ 






What do you think 
Progreun? 


are the greatest strengths o^ the Career Education 

■ ■'- ■ 1- • ■ '. 


\ ■ 


• \ ;■ 











r- 



H^ve you received^ enough inforination about your*' son's or daughter's 
progress in ^e/ Career Education Program? 



/Definitely 
NO • 



1^ 



Definite ly 
-YES ' 



In comp^'Hson with regular schools how much Opportunity ^id the Career 
Educatidh/ Program provide your daughter or son for learning about 
occupatiqns? 

Much Much 
Less More ^ 



What effect, if any, has the Career Education Program had on helping your 
son ori daughter form career plans? 



Definitely 
Bad 



Definitely 
joood 



In cOmparispn with regular schools, how^much opportunity did the Career 
Educa*tion Program provide your daughter or son for general learning? t. 



10, 



it 



Much 
Less 



About the 
Same 



Much 
More 



2 



In comp^ris6n with past experiences in regular schools / how motivated is 
your /daughter or son to learn in. the Career Education Program^ 



Much 
Less 



• f 
ll.j 

» 



• f 



Abdut the 
' Same 



Much 
More 



How wpip;Ld you rate the approaches, to laming uSed in the Career Educa- 



tion Fro^gram? 



Poor 
1 



2 . 



. Excellent 
4 5 



? 1 2 



What positive q|Juiges hav^ yoti noticed in your son or daughter that might 
be a. result of participation in the Career Education Program? 



What negative changes have you noticed in ^ur son or daughter that might 
be a result^ of participation in' the Career Education Program? 



How often does your son or daughter talk to you about what's going on in 
the Career Education Program? 



Almost 
Never 



Almost 
Daily 



^ 1- = = 

About how often haVe you had any contact with any Career Education Program 
staff members? ' 



Almost 
Never 



Very ' 

Frequently 



How many meetings have you attended >during" this school year where other * 
parents of Career Education s<li^ntsVere present? 



None 



4 or More 

/ 



How would you rate the general quality o/ the Career Education 'Program 
staff? 



Poor 



Excellent^ 



18, How would ^o\i rate the ^usines^ or cominxmity reijources available in 
the Career* Education Program? ^ * t ' ' • . 



Poor 
1 



.Excellent 



19. How would you rate your dverall relationship witl» the staf f of the 
Career Education Program? * ^ 



Poor 
1 



3 > 



Excellent 
5 



20. How would you rate the enthusiasm of the Career Education Program staff? 
Poor • " Excellent 



• 21* 



22. 



What do you think- of the ocfcupational» plans of ypur daughter or son? 

a. Q There arenVt any finp plans yet. . • ^'-•.^ 

b. Lj The plans should be diang^d. ■/ * 

c. Q The pl^s seem to be good* " * • 

d. Q We 'haven't rea^Ay had a chance to discuss the plans. ^ 

What do you think s^oyt son or daughter will-.be doing a year af^ter high 
school? . 

a. Working 

b. ' Q ^tending some kind of college 

^* a business or .trade school ' , ^ ^ 

d. -j~|^ Military ' ] ^ 

e. Q Oth§r (please specify)- 



\ 



^ /23: Below kre listed areas of possible importance for a student to learn. ' 

'^•^ Please rate each in terms of Ihow important you^ feel it^is for a student 
."^'J^of^ ta'learn, arid how well you feel the program is accomplishing each. 

■ • m 



<5 . 



=«Students learn to: 



■^^•a. Perform specific occupational skills 

♦ ' - ' ' . ' 

b. Be punctual and organize th^ir tiirt^,. 
c- Assume responsibility for themseiyels 

d. Make decisions and foilow through -Ji! 

: . " ^ • ^ " " 

B-l^^ Communicat'e .with others in a '^r ?l 

maturei way , 

f . ..B'e' aware' of mor^ career 
- . opportunities • ^ 



"Work with others 



. V^. Evaliaate -thei5^^i)wn 



work 



i'^ ^Perform basic aV:ademic skills 
j. Think through and' solve problems 
'k. Have a positive attitude toward sfelf 
' -1. H^ve a positive attitude tpward work' 



m. Have a positive attitude toward 
learning 



n. o Prepare /for furtheb education 

o. ^ Improve- interpersonal cind social 
J''/ -skills ' • 




p". Other (]£) lease specify]?. _ 
» : 



How Important Do 
you Feci This 
Learning Is? 1 



Not 
- Impor- 
tant 



r 
1 
1 
1 

1 

1 
1 
1 
1 
1 
1 
1 

1 
1 



2 
2 
2 
2 
2 



2 
2 
.2 

y 

2 
2 

? 
2 

2 
2 



Highly 
Jmpor- 
tant 



3 
'3 
3 
3 
3 



4 
4 
4 
4 
4 



5 
5 
5 
5 
5 



3 
3 
3 
3 
3 
3 
3 

3 
3 



4 
4 
"4 
4 
4 
4 
A 

4 ■ 
4 



5 

5-' 

5 

5 

5' 

5 

5 

5 
5 



hX* Effective Do\ 
Y^ou Feel the 
-Project Ras Been 
In" Accomplishing 
yhis' Learning? 



Not 
Effec- 
tive 



1 
1 
1 
1 
1 



2 

2 

2 

2- 

2 



J 3 
;3 



\ 3 



Highly 
Effec- 
tive 



4 
4 
4 
4 
4 



5 
5 
5 
5 



1 
1 

' i 
1 

*i 
1 



3 

i . 

: 3 

; 3 
3 
^3 

13 

i 

2 r 3 



2 
2 
2 
2 
2 
2 



4 
4 
4 
4 
4 



5 
5 
5 
5 
5 



4 . 

4 5 

4 ^^i' 



4> 5 



How did you first he^r about the Career Education Pro|i:ain? 



What kinds of stude.nts do you think benefit jnost from Career Education 
Program? 



t 



■ r 4'-- 



V > 



• \ 

^ Appendix A-4 
Employer Questionnaire 



[J 



5- 



P.O. BOX 1348'. ' 

CHARLESTON. WEST \?IRGINIA 25325 
304/344-8371 . 



'afs 



.0^ 




February. 20, 1974 



V 0 



• Your organization^ has been most hclpfijl^ to the Kxperience-Based Career^ 
Education (EBCE) program by contributing time'an'd resources, tlius providing 
6ur students- with an opportunity to learn. It ^s^ extremely important that 
we find out what you or ' your dissociates who work with our '*students think 
about the EBCE progranu A questionnaire was developed to help \xs to obtain 
some of this needed information .* y ^ ' , ^ ^ " 

I have enclosed copies of this questipnnaire and cover letter with retyrn 
envelopes* I would like you " to pass them on to, those people in your dVganiza- 
tion who have worked most directly with our students during the. current sc$iool 
year* - * j ' 

. y • . \ , , , 

I would like to assure you that the information obtained from this ques- ^ 
tionnaire will remain confidential and will not,* be seen by anyone exoept the 
evaluation personnel in the* EBCE project. Printed 'reports of the data will 
contain' only summary in^rmation and will njot contain specific names of 
individuals or organizations. * 

If there are any questions about the procedures or any ot the items on the 
questionnaire, please feel free to call me^at 344-8371. r will be glad to pro- 
vide you with additional copies of the qu^tionnaire , if you so desire* I would 
^PP^eciate it if the completed question'nairen were returned to me by February 27 



Thank you for taking yopr 



information. 



ble time to provide^u.s with this tiiost helpfu 



Sincerely , 





James H. Sandors 
Evaluation Specialist 



Enclosures- 




BOX.)3.48 •■" .J --r / -^.^.y^- - 
CHA'RLE^TOM. WEST VIRGINIA 25325 V- * " • ■ . ' 
30^/344-8371 ' - . - / ' " ' ' : 0/ ■ • " ' • . . * • 

* ' ' : ' ^ . Y' .February 20,/ 1974 



6< 



■ \ 



Dear Kt»sour<:i» 'P.or\?on : 



The Kxpor ienccr^naiicd Career lidacat^on (El^CK) pro<jrdm need^ in forma tion\^ , 
about various aspects, of your * invoXvemont' wit;h KUCK .students. This informa- 
tion' will be used noK orrly for revising thq progrc^m 'accovrding to your comments 
but also the information wiH/be used for a national study in Career Education. 
The enclosed ^questionnaire was designed to obtain the needed information- 

The infoin^ation obtaine'd from this questionhafre will remain confidential 
and will not b^ seen by , anyone except Evaluation jpersonnel , within the EBCE ^ ^ 
projept* ^ Printed reports*of the data will contain only summary information 
'and Will contain neithe.r; specif ic.naines of individuals norlorganizatiojis. 



Careiar Education Ptbgram /;<CEP) - This is the term used in the 
.questionnaire- to refer %o the Expeifi^nce-Based Career.- 
KcLucation ^ro^ram which Is funded by the National© Insti- 
tute of Education .ancj being cje^e loped in' tpo ^haflesbori 
area by ^thc Apixilachii Educational Laboratory Inc . You 
.will probably rocogni^o the program as thd KBCV, j^rpqr^m.- 



Company*-^ Th<^ Career fJducation Programs^ throughout the coufi^ry 
are utilizing X^aricfus types of community r^sourcps. In 
4 this questionnaire any cooperating comnfunity Organization, 

whethetr it'is/-a labor orqan*ization, a* business*, or an 
• educational facility, will be identified by the .term , /- 
co|ipany (Jt site, t ' . 



Si^e"^ Same company. 




/ 



ERIC 



Level'l, II/ III ^ ^ 

. Level I is entitled Career Exploration in the Charleston 
area EBCK pirogram. - It is best dej^ibed as that time 
in which the student* first looks at a career area or job. 

.* Level II is entitled Career *Investigat ion in the Charles- 
ton area rCBCE program. It is best described as that 
period of time after the student has explored a job site 
, is interested in another, more in-depth look at the • 

^ career area. * 

Level 111 is entitj^od Career Specialization Planning. in^ 
, the CharTcston 'ar(?a« EBCE progrcun.^ It is best described 

as tluit perio*d: of ^Ime following Career Investigation * ■ ^ 
*4I when the student has, at least temporarify, decided on 

I ^ a chosen trareer and is afters some specialized training 

or instructions in the career area or job. ^ 

,If, on items 2 and 3; you have no idea which level the students were on 
assiiine the studerlts were\on Level* life • ^ 

Please feel free to contact me at 344-8371 if you have a question' about 
the questionnaire or any of the items. Please return this qtfestionn^ire in 
the enclosed envelope by February 27, 1974. 

Thank you very much for taking your valuable time to provide^ us with 
this most helpful information. 

^^cerely yours, z*^ ^. 



Enclcfsure 



/ ■ James H. Sanders^ 

Evaluation Specialist 



Employer Questionnaire 



Name of respondent' 
Title of respondent 

Name of company 

Type of company 



; Address of company 



Number 



: of employees in the»4?Dr3j[>akp^ ^ ^^"^^ . • 



NOmfier iatt-^^^^ke^s'^^ the ej^i^ehce sit^ 



'»£ength of time respondent has been participating witK the Career Education Program 



l/r When the student is at your site, approximately how- many hours do you typically 
C spend with ^ student? (Man hour s. per ^ week) ' - 

YNumber of hours ^ \J_ ' ^ . ^ 



2. (Which' of the Allowing sbppprtive services do you- (or others at your site) provide 
^or the Caree?* Educatipn' Program (CEP) "students?. Check each appropriate category. 



\ Do you' talk aibout job bpportunities? 

Do you talk about the/students'. personal problems? 

Do you talk about activj,t^^,s at» your site? 

Do you 'tutor in an academic area? 

Do you evaluate individual stildents* assignmrnts? 

Do you assist" students in non- job related a%'s.4gnmprijj^ 

Do you ;su^ervise students to perform a specific job- 
*related task at your site? ' 1 • • ^ 

Do ycu help plan student assignments? 



Other f(specify) 



^Level 
I 



Level 
' II 




Level 
III 



; /S./'Kp)^ '^q studeKj^^^^^^^^ their tirjie i^at'^^wr site?. *^ Indicate the, approximate number 
; ; ;/of,h6urs i>er, w^eV;,f<)r ;each category .(.r ;!^ they are doing more than one thing at 
^> tKe ,^ame ,tihh% solit thb hours accondiiiglv. * ' 



Level Level Le;*,ei/^^,. V- -^^^^ 



Observing sSt'e-activi^es^!; ^^^^ 
' Researching f rom/sTte. mViterials 

..t >ActdV:^ly, perf qrrairig site a^ctivities 

•' 2: J'^x^"*,, ^^'^•'VvV V ^ ' »v' » ' - 

Talking, with >me . : . ' v !: , r 

Talking-with ot^ier. site'persoHnel.: 
: Individual" study ' . "^..^iL'N 7 




other (spebify) . - • - • ,? ; ^ .\ , > ; ; , 

How did .you - become- involved with: the Career Edu^a^iori/Progkam? ^Chefck appropriate * ' 
respqhsejfs) • ' ^ ..^ _ - - -.^ '\ ' V *' : ' • / ' a- ' 



;,^BCE personnel contacted* me about 'the-program. 



J^^y 'A student '-talked to me^ about the program. 

^^Another .empl^i^^^talked to rrife, abo.ut* the program. 



Company; persbnne 1a ta^^ me about the program. 
Other ;^(spe'cify) / v • 



5. Why*.*4i(f you become I'nNJtJlved' wft^ the program? 



6. 



Y?/; . ./?*^^^^ Education Program staff provide, you with enough information to hpip 
A'¥^<^P studisnt activities, at your ^ite? 



/^Y^'^P studisVit activities, at your ^i'te? 

■ ■:: ' . V - 

r.« yes ? : no ' . • . . V^ ." 

^^:^yp^'?^0swered no, what information woiila.Shave^ Boon helpful? 



Vi 



I . i . • < 



7: Would you recoininen^.%o:^anbthcr person (po^tential employer or resource person) that 
' ^he/she also become irty^lved with ^ar-eer- Education Program? 



y^s 



Ji o < 



why^^' 



8* Describe the "type af per^;6n\you think s>K)\ild bo involved with Career Education 

, . .\ \\ ' . 



Program students. 



i ■ 



V- 



9, To what extent has thfe Career Education J^ogram^tiad an impact on the following 
-items? * .:\ ' / • : ^ 



• M ' .ierfoi 



No 



\ ^ How Much Impact 
. '.Some Much ^ Don ' t 



Impac t \ Imp^c t Impac t 



Value of Impact 
Good Bad Don * t 

Impact Impact Know 



ity of work 
-iperfo^jined by 
regular employees 

b. Amount of work 
performed by 
X regular employees 



jCompany hirij 
practices 



Compan^trAining 
pract?'^ 

^I'; Jv4^'t< other •pipssi^i^e 



-4- 





10* In general, do you thin! the Career Educa.tion Program students you havb^j^ked 

.really interested in your site? Circle the appropri at o number from 1 (do^^^nilely h£»J to 
5 (defini tqly; yes) , . * ' . \ \S: V% 



: Dcfinitoly^l 



^ ,1 



1- 



^4 



Definitely 
Yes 



1'5 



ERLC 

I ajinffiiffiffTifljij 



I 



^^.'^^^'IS^^^'fLS^^ yo^lBiink the Career Education Program st'ujients you have worked with 
TVc^^t^^B^r^^ti^^'lnteKested in the Career Education Program?- 



Definitely 
Yes 



12. Iloy/fiave em^jloyees at your site reacted to participation in the Career Education 
Program? Check one. 



Positive reaction 
Negative reaction 
Mixed reaction 



No reaction 
Not applicable 
Don't know 



13. -In whatLjways (if any) have the employees at your site benefited? Check appropriate 



response (s") 



They haven't bone fi tod 

Increased their awareness of youth 

Motivated the regular employees to further training 

R^Suced tho^ir workload 

Iffc^eased interest in their own work 

I doji' t know 

Other (please specify) 



14. Do you i^ceixce- adequate feedback about what happens to the students after they 

leave yoGr site? Circle the appropriate number from 1 (never) to 5 (always) . * 



^ever^ 

1 --l-^ 2 



Always 
5 



15. 



Do you receive ade^ate feedback about the effectiveness of your work with 
the students? ' \ ' 



Never. 

* » 

1 



Always 



:2 



16. How many times and ways. have you communicated with staff during this school year? 



Check as many as apply- 

Almost every day 
Once or^ twice a week* 



Once or twice a month 



rhdividual Group ' ^ 

Meetings Meetings Telephone Correspondence 



Less than*^ once a year 



O tver 

ERIC 



• * ! * 




\ 


\ 








• 




\ 

\ 


« \ 

•17 • Below are listed several area of possible importance for a student to learn. 
Please rate each in terms of how important ^on feel it is for a student 
to learn, and how well you feel, the program is accomplishing each. 






> 

• 


How Important 
You Feel This 
Learning Is? 


Do 




How Effective Do 
You Feel the Pro- 
ject Has Been in 
Accomplishing 
This Learning 




Students learn to: 


Not \ 
Import 
,tant 


Highly- 
Im|K>r- 
tant 




Not 
Effec- 
tive* 




Highly 
Ef fee- 

tirVjq^ 




a. Perform^ specific occupational bkills 


1 


2 3 


4 






1 2 


3 


4 


5 




b. Be punctual and organize their time 

c. Assume responsibility for themselves 


1 
1 


2 ' 3 

2 3 


4 
4 


5 
c: 




1 2 
1 2- 


3 
3 


4 

A 
H 


5 

c 
D 




* ^ d. Make decisions and follow through 


1 


2 3 


4 


5 




1 • 5 


3 


4 


5 . 




. Communicate with others in a 

. mature way , 


1 


2 3* 


4 


5 


> 


1 2 


3 


4^^ 


5^ 




f • Be aware qf more career 
opportunities 


1 


2 3 


4 


5 




1 2 


3 


4 


5 




g. Work with other^ 

at 


'1 


2 3 . 


4 


5 




. 1 2 


3 


4 


5 




h. Evaluate their own work, , 


1 


2 3 


4 


5 




1 2 • 


3 


4 


5^ 




i. Perform basic ac^Xiemic skills 

, . 4 - 

3. . Th4nk thrpugh and solve problems 


1 


2 3 


4 


5 




1. 2 


3 


• 4 


5 




L ' 


2 , 3 


4 


5 




1 2 


3 


4 


' 5 




k. Have a realistic attitude toward 
self 


1 ^ 


2 3 


4 


V 5 




1* 2 i 


3 


4 


5 




1. Have a positive attitude toward 
work ' , 


1 


2 ' 3 


4 


^5 




1 2 


3 


4 


5 




m^ Have;a positive .attitude toward 
learning 


1 


2 3 


4 




T 




3 


4. 


5 




n. Prepare foV^urther education 




2 . 3 


4 

a 


' 5 




,i 2\ 


3 


4 


5 


- 


0. Improve interpersonal and social 
skills 


1 


2 3 


4 


r> 




1 2 


3 


4 


5 ■ 




p* Other (please^ specify) 


1 


2 3 


4 




I 


1 2 


3 


/ 


' 5 








2-5 : ' . 

/ 


• 



18. Do you plan to continue participating, in th4 Career Education Prograiii? 





Yes No 


Don't Know . . * 


















^ ^ ^ 








19. 


What do yc5U think arc the 

(9 


greatest strengths of the' Career Education Proqram? . 




( 
( 






|« 




20.. 


} 

Wh^t do yo^ think are the 


greatest weaknesses of the Career Education Program? 


• 


1 \^ 


— 








21. 


What other comments or redo^^n^ations about the Career Education Program would you ^ ( 
Ixke to make? \ \^ ^ ^ 


m 

7 


— ^ 


' ■ - ^^^^^^^^^ . I 






• " . y 




> 





r 



ERIC 
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. To what exten.t have you had to make dianges in your normal worJc h^its to 
accommodate the students? 



Seldom 
1 • 



Often 
3 



Always 
5 



4s: 

Speci fy :. 

f 
f 

— y 



23, 



To what extent does, working with students interfere in any way with getting 
youx job done? ^ * 



Seldom 
1 



Often 
3 



Always 
5 



24 • 



To what extent are you willing to work with students next year if the Program 
is continued? 



Not at All 

1 2 



Moderately 

3 4 



Completely 

' 5 



25, 



Would you recommend to an associate that their agency become a member^of the 
EBCE program? ;/ . *^ 



Not at All 

1 2 



Moderately 

3 4 



Completely 

5 ' 



ERIC 
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' » Appendix A- 5 

♦ .Student Information Questionnaire 



"A 



•r 



4 



■4^ 

* 



1 

Student Information Questionnaire 



Appalachia Educational Laboratory, Inc. 
Charlestpn, West Virginia' 
Septenlber 10, 1973 



1. 



Are you ; > ' - - \ 

n 

-J I Male 

[ I Female 

Are you: 

f~] White 
^□-BlacH 

I I ^Oriental 

a 

Spanish Descent (Chicano, Puerto Rican, etc.) 
□ Native American 
Other (specify) 



3. 



What is your current grade ievefl (as) of September 1973)? 

a 

10th grade 

□ 11th grado^^ 

Uj .12t:h grade 



4. What is your birth date? 



\ 



MONTH 



DAY 



YEAR 



ERLC 



■ \ 



What is your father's highest level of formal education cojnpleted? 
T~\ None^ i i * ' ^ ' 

□ Elementary School ^ * ► - 

nZlvSome High School ^ . ^ ^ 

( I High School Graduate * | 0^ . * 

Some post-secondary (for example, som^ college, junior ^ilege, 
business s.chool, trade or technical school) ^ 



College graduate (four-year degree) 



n 

Some graduate work 
[Zj Advanced degrefe (specify) 



What is your mother 
rj . None ^ 
1 I Elementary School 

□ 
□ 



s highest level of formal education completed? 



Some High S^cho<j)l 
High School Griduate^ 



D 

.^ome post-secondary (for example, some college, jvinior college, 
business school, trade or technical school) 

college graduatje (four-year degree) 

I \| Some *graduate work ^ 

Advanced degree (specify) ( 



7. What are your -long-range goals?' Check only one. 

□ 1. CLERICAL such as bank teller, bookkeeper, secretary, typist, mail 
Sarrier, ticket agent ' • * 

2^ CRAFTSMAN such as baker, automobile mechanic,, machinist , painte«Y 
plumber, telephone installer, carpenter- 

FARMER, FARM MANAGER , " ' " . 

•4.- HOMEMAKER OR HOUSEWIFE X ' ^ ' 

[~] 5. LABORER such as construction worker, car washer, sanitary worker, 
^ farm laborer • ^ 

Q 6, MANAiGER, ADMINISTRATOR such as sales manager, office manager, schools 
.^^.^^^acaministrator, buyer, restaurant manager, government official 

7. MILITARY such as career officer, enlisted man or woman in the arm^d forcS^^ 

1 \ 8- OPERATIVE such as meat cutter; assembler; ^macftine operator; welder; 
'taxicab, bus, or truck driver; gas station attendant 

PROF^SSIONAI^ such as accountaht, artist, , clergyman, dentist, physician, 
registered Arse, engineer , -lawyer^ librarian, teacher, w;:iter, scientist', 
.social worker, actor^ actress " " " ~ ' * 

PROPRIETdR OR OWNER such as owner of a small b.usiness, contractor, 
restaurant owner j 

n 11, PROTECTIVE SERVICE such as detectiife, policeman or guard, ^ sheriff , 
firemegi - . : 

12; SALES such as salesman, sales clerk, advertising or insurance agent^ 

real estate broker ^ • ''^ ^ 

V 

13. SERVICE such as barber,, beautician, practical mirse, private household 
1 wprkejf/ janitor, waiter / 

a 

14. ^ TECHNICAL such as draftsman, medical or dental technician, computer 

programmer \ 

lU 15. OTHER (specify) ^ ' ^ ^ 

1 I 16. DOr^T KNOW ' ^ 



8. What dc^'you expect to be doihg one year^ after completing high school?-- 

/I 1 ' ^ , ' 

'\\ I Workii\g full-time . ' . 



I J ' Entering an apprenticeship or onrthe- job graining program « 

1 I. Going into regular military service or .to a' service academy 

I , I Being a full-time homemaker " ' . ^ .' ' • • 

, -I Attending a vocational, technical, ^fade* or business school* . * 1 * 

Tak4:tt€^ ^academic courses at junior or community college'* , - - 

I ! Taking technical or vocational subjects at a junior or comaiunity <:oriege. 

I I Attending a four-year cpllfe-ge or university ' . 

♦ I I Working part-time * * ' 

Other (travel, take a break pl^iis) : / 
9. What/i^ your major field of study? 




Ge.neral Curriculum 



□ 

I J Vocational Education CurrjTciSltfltP^ 



I I College Preparatory Culrriculum- 



a 



Other (specify) 



>10. Under FATHER, circle the one number that beat desctibes the work 4one-,by your>-^ 
fatheif (or male guardian)- Under MOTHER, circle the one number 'that ba«t^ 
describes the work done by your mother (or female guardian) • The^fcia^t job ^ 
may not be. listed but circle the one that comes closest. If either of your 
parents is out of work, disabled, retired, or deceased, mark thetjcdnd of ^ 
work that he or she used to do. ♦ ^ T ' 

,r .' (Circle bne number in AAch column.) 



ERIC 



Father 



CLERICAL such as bank teller, bookkeeper, secretary, , 

typist, mail carrier, .ticket agent .-Or 

CRAFTSMAN such as baker, aytomobile mechanic, machinist, 

painter, plumber, telephone Installer, carpenter. . ^. .02. 

FAIJMER, FARM MEAGER ' \ l /^02 

HOMEMAKER OR HOUSEWIFE \ .VTT. . .04- 

LABORER such as construction worker, car washex, sanitary 
worker, farm laborer...* ^ ^^^05 

MANAGER, ADMINISTRATOR SAich as sales manager, offic^ 
lager, school admini^Sjtrator , buyer, restaurant] 
mcuiager, government officietl. 




MILITARY such as career officer, enlisted 



. in *%he armed ; forces < 



OPERATIVE such asismeat cutter; assembler; machine 

operatooe-^'^ welder; taxic^-, bus, or triA dri-ver? gas 
station attendant. ..... ' ' — 



jPROFESSIOJ^AL such as accountant, artist, clergyman, 

. dentj^, physician, registered nurse, engineer , ^ , 
— --J-^er, librarian, teacher, l^riter,^ scientist, social 

worker , ^ actor , actress *. ^. ..... 09 



PROPRIETOR OR OWNER such aS owner of a small 
contractor, restaurant owner . . 

PROTECTIVE SERVICE such as detective, 
sheriff, fireman 



SALES such as salesman, sales- clerk, a 
ins uranc|^ agent, real^estate broker 

SERVICE such as barber, beautician , ^rac 
private household worker, janitor, wd 

TECHI^ICAL such as draftsman, medical or dental 

technician, computer programmer ^'^.......14. 



14 



2 



V'/.' 



y .il Pormative Evalxiation Instrument Package 

/ • ... 



' .','-rAlnstrument 



lumber 



Instrument Title 



Participating Employer Questionnaire 
.Non-participating Employer - t 
Recruitment Orientation Questionnare 
• .^C^r'edit and Grading Questionnaire^ ^1-^" 
Is-.f^^.^l^vV.j^^^^ and-Despri]^tQr--trpdate ^ 



.X,, — ^ 

-7 'rr^r:/ /^.^,,::^^--^B]?estiojanafirg^^ 

^ ^ ^'^'^^jr:Fjr.-J*-:r.-' -^^''retpt jjon'sV'^^ Orfen^id.!^ * " 
^'"^^^^^Cr^ '^;7.RecV.q^^^ & Training 

vM.ri\L"**''^-^r^ Questionnaire/''; 



Questlpnnaire/'V 
Stu<3|^t' Selection; 5 



15 Studetit 

Infonnition ^Sy^stem Questionnaire 



18 



. Pr'ogram Forms Effectiveness 





rxew 

Tr/Site Questionnaire 
T^st for Experience 



^Analysis 

Employer Site' Caser^^d; 

^!^^i}^-^^ioratioT^GvLide - Student 
^Evaluation For- 




-1^ 



FORMATIVE EVALUATION IKSTRUMEKT PACigVGE 



i?STRUMENT NO 




.Title': Participating Bnployer (l.a.) 



Format;; Questionnaire 



Subjects and Sampling: (a) Bnployers (20 - 25 randomly selected)^^:5 
* \ - \ (b) Non-participating employers (as many 

: ' * as po.ssible) ; (c) New sites ^f^';] 

Administration Schedule: (a) &"(b) ad libitum; (c) J^en >ecruitfe^ 
Reliability: No studies needed- ' V ' 



■ w 



Validity: Comparison with othey (informal) information; follow-up 
' ' ^ ; ' ' interview with selected respondents (if time permits)* 1^ 




r^To jQuestiori^ In Part IV Of Plan: A-^l-c, d, e 





#l*a. - Participating Etoployer 



Formative Evisduation 

12/12/73-Hilderbrand, 

Wardrop 



1.' Name of- Company_ 



2;A' Address 



' i\ Sc.t' Name of Respondent^ 

•/ .v Yj»^*V °^ Respondent_ 

^■3 •••<'. 
i-f^J 5v I Telephone, 

VjcafeuND .O F COMPANY 



i 



BAC 



6. What, .are your main products or services? 
." 7. Is thijs: , 



/ 



a. 



An independent company ^ 
b. How many workers ar* employed by the company? 



A division of a larger company 

Hbw^'many workers are employed by the division?^ 



career ^emication program before? 




e. ^ Community me^%ing at which pr/>gram was discussed 

f . Pinployer organization or professional organization 

with which I am affiliated 

g. Other (pleas^e specify) 

Has your company ever been contacted regarding paP^^icipution in the 
Experience-Based Career Education -Program? 

a. Yes 

• No 

\ 

If yes, was the information presented sufficient to, interest you 

in participating as an employer site for the EBCB. Program? 

y a, Yes 

^ b. No 

Briefly describe the j:eason(s) you agreed to participate in the 

Experience-Based Career Edjication Program. 



Is there any part pf the EBC^ Program that does not function as 
you thought it would? ' ; ' 

• ^ a. Yes ' . * 

b. m 

If yes, what? (Briefly explain) ' 



1 



12. To what extent haye you had • Seldom 
to make changes in your normal 1 - .2 
work habits to accommodate 
the students? 

Specify: - 



Often 
3 h 



Always 
5 6 



13. To what extent does working Seldom 

with students interfere in ' J 1? 

any way with getting your 

Job done? \ 

lU. To what extent are you Not at 

all 

willing to work with- 

students next year if the 1 2 

Program is continued? ^ 

I 

• Describe restrictions and qualifications : 



Often Always , 



Moderately Complet ely 



3" ^ 5 6 7 



V 



15. Would you recommend to an 
associate that their agency 



•become a member o*f the 



E|CE Pi?ogram?'- ' 

^Please rate-your response 

on a'.l-7 scale.) 



Not at 
all 



Moderately Complet eily 



3 \ h 



5 . 
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FO,RMATIVE EVALUATION INSTRUMENT PACKAOE 



INSTRUMENT NO.: l.b. 

t 

m t 

Title: Nonparticipating Employer (l,b,) 

■ X. 

Format: Questionnaire w ^ ^ " 

/\ 

Stibjects* and Sampling: (a) Employers (20 - '25 randomly selected); 

(b) Non-participating employers (as many 
* as possible) ; . ^ 

" (c) New sites ^ 

Administration Schedule: (a) & (b) ad ^ibitum; (c) When recruited ^ 

Reliability: No studies needed. 

Validity: Comparison with other (informal) .information; follow-up 
interview with selected respondents (if time permits) • 



Key To Questions In Part IV of. Plan: A-l-c, d, e. 



5 



\ 

V 



yi.b> ~ Nonparticipating Employer ' 
1 . Name of 'Company 



Address 



3. 'TIaane of Respondent 



U. Title of Respondent 

./ 

5 * Telephone 



BACKGROUND OF COMPANY 
6.1-' What are your maiu, product;; or services? 
7. ' Is this :^ 

a.^ An independent company 



c 



b. How many workers are employed by tfie company?) , 
A division of a larger company * i 




* , * d. How many workers^ are employed by the division?^ 

8. Briefly describe the reason(s) you decided not to participate in 
the Experience-Based Career Education Program; ^ / 









( 




\ ■ 











9. tf you never received information concerning the EBCE Program, would 



you like to? 



If you were contacted, why did youj- company decline to participate? 

i 

' * Did not 

\ Major Minor Sin'oct 

Declined to l^ai-ticipate ^ ' Heuson . Keason decisions 




plain^^ 



a. Antioipat<^d complaints from 

regulai- workers ' S ) ( ) ( ) 

"b. Anticipated complaints ' \ 

from customers ^ ( ) ( ' ) ( ) 

c. A!^ti cipjit(Hl ])r(>bleras 

wi Lh ::l.u.l.«t.(.:; ( ) ( ) ( ) 

<i. An I. i (• i p.'tt.t'il union [')r'ob I fia:; ( ) ( ) ( ) 

t». Vvo\sx\m would hf too 



expensive * ( ) ( ) ( ) 

f . Program would too 

'time consuming ' ( .) ( ) ^ - t ) 

'X- 

g. In, another program. '\ • ( ) ( ) (' ) 

h. Other employers reported 

unsatisfactory experiences. ^ ^ , % 

(please oxplain) ( ) ( ') . ( ) 



f 



i.. Company about t^o change * ' . «> 

• management \ if ( ) ' ( ) ' ( ) 



J. Other (please explain^^ ^ ( ) ' ( ) ' ( ) 



FORMATIVE EVALUATION INSTRUMENT: PACKAGE 



/ 



INSTRUMENT NO. : 2 



^ Title: Recruitment and Orientatiori Questionnaire (Learning Coordinators) 



Format : Questionnaire 

^* 

Subjects and Sampling: Learning Coordiiiatofs (A1V) 



Administratioii Schedule: Immediately after orientation is completed 



Reliability:^ No studies needed. ( \ ' . ' • ^ 

VeuLidity: Compare with data from other sources (students. Design staff) 

( 



Key To Questions In Part IV Of Plan: C-l-a; D^-c, k 



■•A 



) Formative Evaluation- 

■ - ' ^1 VJ^/12/73-Htlderbrand, < 

L Wardrop ^ 

#2 - Recruitment and Orientation Questionnaire (Learning Coordinators.) 

1. How well do you think the material"^ used to recruit studerflfe; 
' reflect the .naturo jind purpose of FJ5CK? 



V?ry ^3 ■ Fairly . ^ , Ggmewhat, Poorly, shouia \ \ 

I w^ll well' but could be changed 

^ . be improved * . ^ 

If you chose c or d, please suggest changes: * * / 



The general sequence of activ^-ti^ Muring the orientation phtlse. 
is as f^iffows : ' " . 



tjiere oth^r act^ivities .which should be included? Yes 



\ If^yes, specify"! 



No 



3. Are there activities which should be deleted from th^ orientation? 

Yes No, . s • A ' , 



If yes J specil'y: 



. 4 



U. t/ould you\3u/:;ger;t any/ changes in the r.oqiioncing, of orientation 



act'ivities?^ 



Yes 



No 



Tf yes , what changes? 







. 'V 


• 








' ^ ^ « 



























One 'of tHe importanj:. products tproduqed during o ion is -lite ^' 



* studfent Program Profile* According to the ATlL/EfiCE/ model, the 
\^i^rofile IS baSed on student n^eds ana interests ''as' pefle^te'd^n: * ^ 



rofile 

Transcripts . - 1." 

Diagnostic inf origination '(skills 
Expressions of interest 

t r 

Measures of aptitudes and abilities 

... 



' 5- Do ^u l?eel you have all«>the information you need about' each ^tu- ^ ^ ^ 

dfcnt when you attempt* to Cotnplete the Profile? ' Y er> ^ > ^No 

1^ lo,^ please check thoSe items you are typically l^ckingi' , " / ^ . ' . 




Transcriptys 



Diagnostid i,nformation (skills) 



Knowledge. of- student intere&ts . • . 

. . .< • . • ■ ■ . 

Information about agtitudes- and abilities 

• • / . .. ♦ 

other information which voul^ ;be useful . 

Please specify: 



IBSTRUMENT NO. 



FORMATIVE EVALUATldN INSTRUf^ ij/JckAGE 

■' 1. i II 

■ • ■ • ■ ■ y '"'^ 

Title: Credit and. Grading Questionnaire ( Learning^ pooRtttiat 



Format : Questi onnaire 



Subjects and Sampling: Learning Cpordinators (All) 



* ^ Administration Schedule: 1^/73 and 3/Y'« 



Reliability:' Mo r.t.iuii c:; lu^eded 




Validity': Compari^on_acros«-H?es^pondt?nts i^^^ wi 
,3 selected respondents. 



Key To Questions In Part IV Of\Pl^Lri: D2-r-g, h 
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drniatlv^.^ Evaluatiiop' j ill 
, 12/l2/7i-Hilder?)j{an<!t, '^'1 "H' 



' i Credit and Grading Quest>afmaire (Lbayning Coordinators) 

AnJ^fnportan.t part of uri I.C's, duties is detcrminiiig'tlle'^creXi^^ 
"t dBw ,cafr~^Brn:-by^i5^ucie^ completing Ion activitx- Quentio/is 1 



\ and^2 deal 'with thls\task, 

1.- Are you awai-e of ixny guidelines for d^cidi'r/g" tho "poiht^jimrues 
Qf 6Ln activity? ^ Yes No 




student has completed the^^^^tasm^ j specil ... x 

an LC-niust determine how much credit should^fce g'^^VpiV^ C 

... ■ 

tftere spe^fic criteria for judging the ade^ila\;y of vSiija.dent 's' 
) perfo^rmance? fe s ^No (Tf no^ sKjp to QueBtion ' , \. *• / 



ERIC ' 



1^ - 



:: {. a. plear 

*' t* ' - . 

ll yih. Pifficult to apply 




Unknown to. students 



ri^fly describe the criteria and proce^dures you use in deciding 



t how. much credit a completed activity- shall receive. 



4 I T 



■■ r 



■ • / N 





FORMATIVE EVALUATION INSTRUMENT PACKAGE 



/ 



TRUMENT NO. : U 



Title: Program Profdle and Descriptor Update 
Coortlinator^ ) . ' ; / 

* ' * -"-"^ — 

Format: Questionnaire , ^ 




Subjects and •Sampling': Learning Coordinators (All) 




Administration Schedul/e: . After weeks 9/l8, and 27. 



Reliability: No studies needed 



Validity: .Comparisons across respondents; follow-up with selected 
' respondents. . - 



To Questions In Part iV Of Plan: D3-l-a 




check all that apply) 

, M'rcinscr iptr» ^ 

r)tu<ient oxpreJS'jed intoi:e?>tL3 

V Heyutts or*previo\iS activities 
Other (specify*): 



Its there any information you do not have that you would find 
useful in updating the Profile? No Yes (specify) 



















4 







^ 1 » 



About how frequently *(io you prepare liew IVogr-iun Area DescriptoriS 



for a .student? 



- ERIC 




Record ol' bLudent's past hcL i vl tles/accomplislunents 
in mCK 

Other (sp'ecify):_ 



X 



6, Is there any information you do not have that you would find viseful 
in updating the Descriptor? _No Yes (What?): 



ERIC 



_ FORMATIVE EVALUATION. INSTRUMEHT- PACKAGE* 



INSTRUMENT NO-. : ' '5 



JJijble:- Trainitig'- of Learning Coordinators (Learning Coordinators) 
FormatT: Ques;tionnaire 

SubJects^^aii^^aj^Ii^ Learnt?)g''X:oordinators (All) 




Pliability: No studies needed. 



i^SIidity^ Comparisons with responses f^m Design Staff; follow-up** 
with selected respondents* * ^ 



sr. 



Key To Questions X^i Part IV Of Plan: D3-l-d 




/ Formative • Evaluation-^ 

12/12/73-Hilderbrand, 
Wardrop% 



#5 - Training of LC^s (Learning Coordimtors) 



!• In^preparation for assuming yova; duties-. as a Learning Coordinator, 

. . * " / '^^^ r ' ^ > . ' 

did you receive* any specifijc instruction or training in the 

.following ar^as? / , ' * ' { 



Yes 



1. Philosophy, nat\ire, and operation of EBCE Program 
Role of employer sites in EBCE 



3. ^PuJ 



Purpose, relationships, and use, of the various 
forms used in planning and monitoring students 

4. Developing appropriate sequences of activities 

in individualized instruction' 
- .5. Evaluating student progress in' individualized 
. instruction ' * 
6.« Writing behavioral objectives 



2. ITow go back through the ;^pics named in Question 1 and circle 
.the numbers of those fo;r* which you think LC's should receive 

specific training. ^ . * 

3. Estimate the total number of hotirs of training you received in 
preparatipn' for assuming your duties .85 a Learning Coordinator. 



U.' Did you receive any other training to prepare you^to be a Learning 
'Coordinator? ' No Yes (Specify^ tppics covered):. 



\ 



What kind of ti^aining do you think a new Learning Coordinator 
should receive? Please indicate topics to be covered and give 
a rough estimate, of the amomt of time you think would be appro 
priate. ' ^. 



J 



FORMATIVE EVALUATION l^NSTRUMENT PACKAGE 



IMSTRUMENT NO;: 6 



cTitle: Assessment of Students* Perceptions To^^^s Orientation 



Ponnat : Qiiestionnaire 



Subjects and Sampli^ng: New students (All)* 



Administration Schedule: At,j;onclusion of orientation. 



Reliability: No studies needed. 



t 



Validity: Compare wil^h data from Learning Coordinators, Design staff \ 



To Questions In' Part; IV Of Plan; C-l-a,,i; Dl-l-k 



ERIC 



Formative Evaluation 

12/X2/73-Hilderbrand, 

Wardi^p 



§^ - Assessment of Students' Perceptions Tovards Orientation • ; 

1. Listed jbelow 'are some of the objectives which the staff of this 
projeqt thought were important for orientation, , I n yo^u r opinion 
• did the stlaff accomplish their objectives? (Circle either yes or no) 



1. To ,give you a general overview of the purpose 

and goals of the EBCE Program. 
I?. , To introduce you to your Lefirning Coordinators 
and other EBCE staff members^ and to Tajnl 1 Inrii'-o 
you with the rple' these peroony play in the total 
EBCE. Program. 

To acquaint you wiih forms you will be dealing with 
throughout the school yeaaf, including Activity Sheets , 



Yes ' 


# 


















1 

\ 

I 












\ 

t 


> 



A- 



» ! 



3. 



Program Area Descriptors , ^nd Einployer Site Selection 



i<5n'- 



Forms, and to provide ioformati<5h that vill eila"ble 

• ■■ • . ' . . ^ ' 

you to fill them out neatly and accurately. 

^4. To give you a rough idea of the acac\emic and ^caree$ 

education learning opportunist! available to yoU 

at 2-3 empldyer* sites. ^ • 

< ^ ' . '* 

5. To help you ^ make an informed decision regarding 

whether or not you' wish to remain i;n, the 'EBCE Program. 

6. to aid you in the solution of transport^ation problems. « 
T. To orient you to the types of opportun:^ties available 

, to you at employer sites and in. the World of Work.^ 



t * 



■n. 



Based on your knowledge of the Program, can you list f-three things 



you particularly' enjoy about the ProgMp? 



If yes, what are they^ 

:^ _ ^ 



r 



Yes 



No 



Can you think of three things you particularly dislike about the 
Program? J Yes No - 



If yes, what are they? 



What are your feelings about the staff at this time? (Check the 
appropriate answer) ' . % 

■ (a) very good* * (d) poor ^ 

(b) good ^ . (e) very pdory- ^ . 

. • ' (c) fair 



ofthe project, what would you change? ^ 




rv i. 
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6/ H^iy did you first find out about the Experifejice-Ba3ed Career « 



EduQation Program? (Check all that apply^O 

5^ I receive^ a letter about the ^ogram in thV;niail/. 

I picked up/was given a pamphlet about the Program at schojJ^ 
I read the ad about ^the Program in the newspaper* ^ \ 

1 read an arl^icle which desdrihed the Program ^-n the newspaper. 



* I heard about the Program on the radio on Station 
I heard about the Program from rnyjligh r^chool Cpunselor, * 

J^he*r<J about the Program ffora n'^frierul who was in the 

<» • I -* 

Program last yjeaji, » - , - - a 

> 

I he^rd about the ^ogram from a friend who had heard about 
.it or read aboutt it. ' ^ 

.1 heard about the Pfograia from, one of my parents or another 

"■ ^ , ■ . ♦ 

relative who had heard about it- or read about 'it, 
I heeurd about , the Program in aji Assembly at school. 
I don't, remember hoy I found out about the Program. 
Other _^ • ^ ^ 



In your oifimion, what is the most effi'cient (best) way to let students 
know fitbout the EBCE Program? ' 



In ydur opinion/did we-do a good Job in describing the EBCE- Program 



to tlfe public? .(Check one) 



^ Yes . , 

1 No 

J 'Unsure , 



What ! improvements can we make in this area? 



■V 



I,. 






No 

i> 




• 




' ii ■ 




' I'- 










• 










s 




— 
























^ ; • ■: 

7. Math overview (circle- either Yes or No) 

? • * 

A, • Did .you understand the information p'resent/d? 
, ^ • " * . • \ 

- B,. • Was the information prfesente(5$qlearl^? ' 

, . ■ % ' ' ' ' . ^/ • 

C. ^ Was the person that presented the infon^toLon prjepsured?' 

8, communicat^n Overviev/ • . ' / ^ 



A. Did you ' understand the inforiijatiion prdfsented?- ^ 



Br. Was the information presented clear 
C. ' Was the person- .that presented vthe"(/nf ptmation pr^pkred? 
9. Natural* Science Overview / * /• ' 



A.^ Did you understand the informaMon' presented? 



C.J, V?as' the pprsop that ^^>resente<i the information prepared? ^ . 



B. Was the information 'presented clearly? 

« * 



10. Sbcial Studies Overview 



B. Was 



A. DaAi*you understand the information pacmawted? 

' . : .^-^ . : y ' 

Information pijesented clearly? . . . ^'^^ 

C. Was th^^ersoh tlia^ presente^tiie infoigt^TBlSnUprep^rfed?- * A 
11. Career Education/6vefview - ^ " \ 



A, I Did you understand the cirifoxjnation presented?* 

B. Was the information .presented clea^y?;^ 
.d. Was the^'^rson that/presented ^the i^fprjnation prepared? . 




4 12. Exposure Tours 



(a) Whrch tour was thfe m<^ interesting to you? 




/ 

/ / 



/ 

/ 

't 



[c) Based on your interest; , j^h^afe-^rours wo'u,l'd. you like to see iri the' future^, 




(d) Was >any tour of no" interest to i'ou?; 



13 . ^>rogram Profile ; 



(a) Do 

tOu 



r,-'.. 



: r ; 
• : i 

' I 



1 ! 



> you ^ feel your Learning Coordinator adecjuat'elV prepared. 
Duhelp you? Yesf/ \' \\ S \V\\ 

Cb) What is the purpose of the Prograjn 'Prafltle? * tV\\ 



id 
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\ 



vV 

\1 



4 




PfograLin Descriptor 



(a) Do you feel' your Learning Coordinator is adoquattily prepared 
to help you? ' ^ Yes ^ No 

(b) What is the purpose the Program Descriptor? 



Career Education Workshops. 

(a) Do you feel your Learning Coordinator is adequately prepared 
« to help you? Yes No 

(b) What is the purpose of the Workshops? 



^' ;l6. .Are you happy' a^ont tAe L^earning Coordinator you-'ve been assigned to? 



yes 



No 



17. Do^ycDu feel the Learning Coor\5jLnator \s interested , in you?- 



Yes ■ 



f % 



No 



Do ypu feel the Learning Coordinator is adequately, prepared to 
he^p you? ' :^ - . t 



Ye*s 



No ^ 



19. 'Based on what^yAu know about this program, how would ^ou comp'aro 
. i\ to the school you were attending last year. (circle- ybur 
response) " * x ^ , y ' 



\ 1 



•ar- better than- 

^ ... • 



b. as good as 



' c, ' worse than 



20. >tf you could change some part of the orientation, what would, it, be? \ 



I 
I 



rr 
% 



1 



4 



\ 



. FORMATIVE EVALUATION INSTRUMENT PACKAGE 

m ' 

INSTRUMENT NO. : 9 



Title: Recruitment, QOalif icatiops and Training of Learning Coordinatoris 
(Design Staff) ^ . ^ 

Format: Questionnaire ^ - ^ 

Subjects and Sampling: Design staff involved in developing Learning 

Coordinator role; Operations Staff 



Administration Schetiulej Early 197^- 



Reliability: No studies needed, 
Validity: No studies needed; 



Key To Questions In Part IV. Of Plan: D3-l-d. 



/ 



. ' , Formative Evaluation 

a2i^-12/73-Hilde^brand 
^ }Wardrop 

Recruitment, -Qualifications and Training of Learning Coordinators 
(Design Staff) V 



Sow are Learning Coordinators recruited? 
a. Met'hod(s) uced to publicize openings; 



b. Population Trom^ which LC's are obtuinod: ' . ' 



What are essential -or ,depir^le qualifications, of Learning Coor<fi- 
nators? ■ 
a. What academic training? • , - . 



b. .Whatf previous experience? 



c. What'.j)ersonal characteristics? 



After a Learning Coordinator is hired, what kind of training does 
he/she receive? Specify conteiit and approximate time required . 



■ ! 

i 


— 0 












\ 


«... 


V • ■ • • 



What kind of training should new lieBLrning Coordinators receive? 



1^ ■ --..i. 



FORMATIVE EVALUATION INSTRUMElfT PACKAGE 
INSTRUMENT NO. : 11 ' 

Title :v"-iJearning Guide Questionnaire (ifesign Staff) 



- :-Fprmat< ' Que^ionn^'re 
Sul)^ecta^|[j\d-;Sampling: st^i^f ^rersponsible for preparing learning* 



AdMni^^ktion^^eKeSol;^: Ear lyAiP.T^ . 
Reil'abifity: " No'^studiei' needed, y' " 
V€Q.idi"lyr No studies noT^dedV 



Key To -Questions' Part IV tt VX^x - X^^V^c''- 
« ' > . 



ERIC 



T 0 

' ' ' I 



ifil 7. Learping Guide Questionnaire (J)esign Staff) 



Forma,tive Evaluation 

12/12/73-Hiidertrand,^ 

Wardrop 



4 .1* On'^the. average , how 'much' time does "^t take to""Translate site 
^ analyses information into ^a Learning Guide? 



Hours 



2. 'Are, there any d'iff icultiel you regtdarly encounter in preparing 
a Learning Guide"?^' thei^ any^^ Information you need but' dO' not 



usuaMy have? v^."^ 















' : n ■ - - 




- ^ V ■ 
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, A. 



5^ 
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V-'. 



/I 
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FORMjlTIVE EVALUATION INSTRUMENT pAcKAGE 
'INSTRUMENT NO. : 1^ . , '' , ' ' ^ ; 

Title: Student Selection, Questionnaire (Staf^) 
Format: Questionnaire . " \ ^ 



Subjec ts and Sampling: Selection Task Force (All) 



Administral^ion* Schedule: /^2/73 and 2/7^. 



Reliability:^' No' studies needed. « ' ^ 

Validity: (i2/T3) Compare with informal knowledge; (2/7^^) compare 
with evaluator observations of selection process; (both) 
compare with.* student records. 



Key To Questions In Part IV Of Plan:. C-l-f » g. ^ 



^ 4 



r 



( 



Format ivQ Evaluation 
12/12/7^3-Hiltierbrand 
W^drop 



- Student Selection Questionnaire (Staff) 

/ * ' 

Which of^ the^folloving criteria were used in ineiking acceptance/, 
rejection "decisions for s4:udei^ applying last fall? (Chedk all 
which were actually used. ) \ 

&• Eligible for enrollment in Kanawha Coiinty School system*. 

b. Within one year 'of diploma. 

' c. ^Course requirement limitations. 

d. Compatibility of .express-ed career interegt with program 

capability. , . - 

e.. No participation in c^onfiicting work activities. 

f. Transportation considerations.^ 

g.- Health and/or personal adjustment concerns. 

■ h. Absence bf extramural commitments which would interfere 
with EtfCE involvement. 
i. Ability 3*evel. 



7 ' 



Other: -{Specify) \: 

1. , : M il l I . I 'Ti i / ,• 



. .... . r%/^i, • ^ / 

Under ideal circumstances , whicn-^.^t||]a; above crit^'Hit^ dp you think 
is/are the most useful for selecting sTu,^ft*tA. who would prof it -prom 
the EBCE experience^ (Circle those that at§i|y'\ ) 



If there are- any criteria you' think should be used which were not 
in the past, what are they? * ^ / ^ ' 




FORMATIVE EVALUATION INSTRUMENT PACKAGE ' 

''-e< '■ ' . 

W ' • 

INSTRUMENT UO. : "Ul. a.- 

; ^ ■ . _ 

Title: Nonp^tfcip'kting* Students* • ' ' 

Pormat: Questionnaire _ ^ 

Subjects and Sampling: Students choosing not to participate in EBCE (All) 



Administration Scheidule: 'As needed. 



Reliability: No'f studies needed. ^ 
Validity: No studies needed. / 



Key To. Questions In^art iv'^^f Plan:' C-i-i ; Dl-l-e; D3-l-b. 



ERIC 




-/ I- 



/ 



V 



F^j&native Eyaluatio'n> 
12/12/7^-Hild^rbrand , 
Wardrop r 



^l^^a. « Nonparticipating Students 
1. Name ' / 



2. School Attending_ 
A\ Grade'' , 



l^bcwcted Graduation Date_ 

Are.ygu: (Check only one in each column) 

^ a. Male ^ 

b. » r Kemulo 
6. What is„ your §chool maJj3-r? <C * ^ 




7. What category be^t classified .your overall schp'ol standin^^by way 




of grad^' 



•A (90 +) , \ C ^ (70-80) ^ 

B ( 80-90 /_ 



-F^ i\^lo\f 6b) 



D • > ^6 60-70) ] • 



8, Have ypu ever received i'nformation or»b^een'contacted about the \ ^ 



0 



Experience-Baaed, Career Education^ Progrlam? 



a, 
b, 

^ c . 



_Yes 
Jo ! 

Don't remember 



If "yes, "tirfefly explain wjiy you decided not to participate^ 





FORMATIVE EVALUATION INSTRUMEMT PACKAGE 

t 

tNSTRUMENT ^0 , : 1^ .b'. 



J'oirmat : j[nt er vi ew 



/ 



Subjects arJ^T^Sampling: Students choosing to drop ^lir of EBCE (j^). 



* ' Adn^l^isWatioh Schedule; * 




As needed. 



\ 



lieeded. * 



Validity: No studies needed. " 



i Key To ^estipns In Part IV>Qf Pl^; "c-l-i; Dl-l-e; D3-l-b 



1/ 



1 . '^C .^v^ . 

^' ■ I' ■ s /i 

" if \ 






\- 



Formative Evaluation 
12/12/73-HirCterbr^t(,^ 
Wardrop . Sjf^ 



fHk*\>. -- Student Dropout 



1.' . Name. 



Date: 




2. School Atte^ding_ 



\ 

3, ' Grade - \ . * 

M.. Expected Graduation Date. 



^5. Are you: .j Check only one in each/cblmn) 



Male 



^'Pfemal^ 



^What'caxfegory best classifies *youi!-:.pveyall^st^hool -§tandi^g by >;jf^ 



What is your school major? 



^ \of tgrades? ' ' 
^ ^ , A ^(90 +) 



■F ".(below 60-) 



Ei (80-90)- ^-^^'^ -.r&t^^^eo-T^J^ -? , 



>■ 



itate ypur reason or dropping- out of 'the EIBCE Prog^raJirl. 



> , -« 



■ /!''/'■ 



— : ^ — - — 

■ 9. ^Who was y'our Lear'ningX;oordinaj^r?_^ 




■\;/r 



l'4. 




IIBTROMENT N0.:-';i5.' 

< ^ ♦ / » * 



. Titles Studeil4' Program Development 'Intervi'ev/(L 



''(.Learning " Coordinators ) 



. - /Format: /int'^rview 

/ Sul3*Je^^t^;iB[ha Sampling: Learning Coordih^itors (A1.1) 



/' / 



/ 



if? 




/ / - • / .'VAciinistration Schedule: .^rly 197U 

v<' -/ m -^v / '.J ■ ^' 



•'■'///}' ReliabiiiV : ,,Mo studies, needfed 



1,(4 



'^"^:-*Y/ j\ Validity;/'' Comhari§ohs witli informally o'btafned information. 



,/ 



i , 
f ► 



^..^^^^^K^?^^ In Part. IV 6f_Plaiir^B-"l^4T^ c., e. 



ERIC , 



» - 





: ■;i!f 



*7ormative Evaluation 
Jl2/l2/73-Hinaerbrand 
War drop 



#13 Student VProgram Development H^erview (Leering. Coordinators) 



Introduce: 



One' of the most important aspectS- of a Learning Coordi- 
''nator's Job is the design and monitoring^ of stUdent 
programs. There fiire a number of steps involved: in this 
process, and at each step there are new forms to complete 
:>and old forms from* which to obtain necessary infonnation. 



^ Whsi't I want to do today is get some reactions from you 

about how' well the system works , how useful the forms 
are, and what kinds of problems you encounter.. 

Continue : Let's begin with the orientation period. At that time, 

' * you and the student complete the Program Profile and . 

I Erogram Area* " Descriptors * In order to completed the 

/ ProMle, which pf the following sources of information , 

do you use? . ^ - 

"Yes" ' Transcripts * 

" Achiev^ent Test Scores / 

Kuder Results ' . - 

Information . about the student ' s^ -general -^^^--^ 



(1) 



or 



r 



ability (if yes , .proij^Y > What^ specific alijy?.) 



? 



. Diagnostic Testing K^^'ulti . ^ i 

The ^student • s exprpsaed. needs and interests 



Follov-up (For steins to vhich 
response was "Nb")i ;^ Yoxi, don't use 



(2) 



I Why^ not? (Probes: Becaiise the information is 
not available? Because it is not useful?) 
(Repeat for all items to which LC responded "No".) 



Continue ; 

• , f 



LOiT you 



Is there .any other informalioiP you would like to 
have available when you complete 'the Profile? 
.Clf ^'Yes", probe ; WhatS) /' / 



Then : ■ 



Do feel you know the student wfell enough to 

♦ • ^ 

complete the Profile accurately iy the time you , ^ 
are .supposed to do it?^ (if "No", probe : What 
changes In procedure would you suggest?) 



r 









■ 'i 
















7^ 








- — 


'■ // 

^ ,^ 


' 1 




\ 



•-c ■ ■ ■ ^. 

Btert : When you fill out a Program Area Descriptor , do you find the 
(?)^ ^rofile helpful? , . 



— ^ ■ 

Is there any informltion that is not in the Profile <^hat hoy, 
would find useful? , * • / ' / 



Would you suggest any changes in the format /n which informa- 



tion is presen-fed in the Profile? 



\ (6) ' What about the format of the Descriptor? . ~* Any changes you^ 
, wouia like to make iihere? - 



.(7) 'One more c^estipn^bfefore we mov6 on.. What .do yoi:u-do wlien a 



/ 



studlent expresses an-.^nteresft i^'a career not presently. 



included in -the EBCE sit^s? 





ji - 
















i 

(8) ' Now let's go* on.^ the" next step. Based on the Program' 

. ' \ ' . — 

Descriptors . you desi^ a- set of learning, experiences for the 

student.. Dd you have 'any diffigulti^ In developing these 

^ learning experiences on the' basis , of" the Descriptor? (if **Yes" 

What kinds/of problems?;)/ 'j^ ' ' ' 



(9) 



vniat other considerations besides the ^Descriptor are involved * 
in developing a le&;rning' experience?^ (For example/ Umiibationg \ 
m availability of in-house'or community res*ouKces, difficulties ' 
caused by -the lack of a cross-teference catalogue.) * ' 



i 



(loy C^n :^au give me stn estimate of the":average amount ol)' time kt ^ 

takes you to prepare an activity sheet from a ProkraA " Descriptor? 



(31) 



Do you have any problems because the approprf atej inS'itructibnal . * ' 
materials tpeople or things) f^Sr'some activities are hot • ^ 
always readily available? (if "Yes":' cWyoii s^gge'st^ $ihy wkys ^ ' • T 



for '^eaiing- vith. this problem?) 



TV 



-r 
.- I 



4 



0^- 



Just a f ew=«iore 'quesi'i'onS ghd we will be f i-n^shecf. Iji i^Mnntrig 
emfJtoyer-^i^e based acitivl^ies, do"ybu find the^'Learhing Guides ' 
,T^efu}?, ■; ' • ^ 



^(12)- 

f ;- 



'5 * I 




■ -V, 



■ a. Are thereby ch§uiges you vould lik§- to se^ in. the contept 



of Jjeeiming Guides ? 



i 



b. Is the 'infarmati't)^ presented gener'frlly clear and' under- 
i standable? / ^_ ■ '-'^ 



'c*. What about the fortot of- th6 Learning Uuij^ea? Would^you- 
* lik'e ^it changed^ in • fimy! way? . . 



6. 



r . 



3".. Do you us^^. Learj^lng ^ Guides regularly? 



Jit^eajsy- or^ 

" '^i'^ • ■ -^^-^rS^ Sheet froth la- '^y^rning/^Gul^ef ^ ^'-^ ^ - 



ev- -Do^ybTa''^f?i^nd'1:t'^eaUy- or' difficult tg- prep^e^afi^ ^Aetdylty 



C -'1^ J ' , ^ ^- • • ^ ■ /'^ 'fr r-^"^ " y.-. 

. ERIC-..;: y^!:^. -^v ' I'i.f-^ .\ %; •• ^':ir^--i7^> ■Z-'. -'^a-- ••'^r;,? 1 



■FORMATIV%.EVALUATIpN,- INSTRUMEUT* PACKAGE 



INSTRUMENT^ ^10;:-^ -17 



Title? Informat 161/ System '^e8tionftaire?/Learni\ig Coordinators) 
Format i Questionnaire 7 - . • ^ v 



Subjects and /Sampling: ■ Learning Coordinators (Ail}- y^'. 



iriistration Schedule?" 3/7^*: 
Reliability: .No studies needj^ 



Validity: Compare with anecdotal inforinatxoh. 



A-- 



V'. 




tions Ip Part IV Of Plan: ^ ^-1-e. 




1/ ^ 



V 7 ^ 




Formative Evaluation 

12/12/73-Hilderbrand; 

Wardro^ 



#17 - Information Sygtem Questipnnaire (LeafUlnlg^V Coordinators) 



A Learning Co^dinator must,hav€^ ready access tc^^a large quantity of 
Informatibn.in ojder to succ^gssfully implement tfife Instructional delivery 
?ysteni. 'Fhis questionnaire is intended to provide infqrmation about 
your perceptions of the effectiveness and effici^cy of the "information 
support system'*Vused -j^or 



1* fiOf^the followijig sources of information for is^.in preparing a 



stu^^t Activity Sheet, "which ones do you fipd-helpfulV 
* ' (*Circ1'e^ the b'e&t!) i^pspons'e. ) j 



Program ^^a Desprip^rs ^ 
' 'Learning puj^oes . _ 
* ;ln-H^'Se. Guide to, Lab Materials 




Core Activity Sheets 
- \-pross RjQference CatalQguV 

2..- 'How f5equentl^..dt>you^^cpu^ in .locating Information 



you h|^^d^of' pl^nning^tudejft activities? 



FORMATIVE EVALtlATION INSTRUMENT PACKAGE 



IMSTRUMENT, NO. : " l8 • 



Title: Interview -.Ijearrlinfr.Gpc^rdinators' Reactions to Program Descriptor . 
* • an^ Employer Site- Selection Form ^ 



Format:"^ Interv: 



Subjects ^aiOTSampling:; Students (Random, p^lO, 5 to. -receive/both l8 

and 19.) ^ ' ' ' ^ 




\ 



AdminiatratiV Schedule^ -S/T** 



\ 



\ 




ileliability : Cojnpaxe responses on, itema common to instriunenlis 18 and 19.^. 



,^ for students receiving both. 
Validity: Compare with st-^'dent records. 



^____jCey>Ta Questions In-Part Vi Of Plan:, Dl-l-f, g; D2-l-b , ; 



¥1 



Formative Evaluation 
12/12/73-Hilderb2*aiid , 
Wardrop 



#18 -. Interview - Learning Coordinators' Reaction To ProgrW Deacriptdr 



and Employer Site Selection Form 



Materials Needed:' -Program Descriptor for each student 

^ .. 

Introduction : A majoj* emphasis of the Exper^4^^-B^5^ Careeif Education 
Program is tQ develop vehicles b^^hich we can transport 
to yQu, the student, a meanin^ul^ -learning experienqe. 
' The ipethod we«choose for/lJetter or worse was through ^ 

series of forms. These forms include: Program Descriptor, 
binployer Hi te Selection, Learning? (luhieii, AcM.lv I l.y ::iu^<M.n," 
. uiijci ixo forth. I'm sure you are able to^.identil'^ many/ 




more, but for the time being it's Just important, that 




fbrms exist . 

today is discuss with you and get 
w of the basic forms I. mentioned^ 

the Pro-am Descriptor ; and t^e 
oh^ Forms . 

^egin /today by discuksing the Prograln Descriptor . 

^ Ay/ ' 

Duy^ing oyaentation you and^your Learning Coordinator 
c0mpj^fe^ted. the ProjpreuaVDescriptor . . In ^order^ po.Ab .this , 



..I 



at information was^heecied? , " 



Achievement Test Scores 



Generfel^Ability Information ab^t, you. 




(2) 



Can you tiiink of any othe)*'^ infonaation thjat is needed?^ * ' 



Driae 

(Prqb^ the student for und§$j§.tanding. )^ 



Clue:' Other instrument^, such^ Ciare^r Maturity^IntJrjl^w^ *f 

student exp):es^es his/her , needs .* ' * 

' 'Program '.Profile / ' ^ 



X 



'POse ofl 



the^Prggram^Descriptor*, cop-. 



If ^ the s^tofient understands^ the purpc 
'*inue.\ If not, probe deepey* or explain* the fro^ram ^escriptpr to the. r ' 



student ♦ 




Continue : 



(3)- ■ 



Ili *rs on the basis of the Rrogram. DeAriptor-s" ttiat the 
^jtecif i^" learniSg' activities- yoiSt do^are* suppdsed to be, * 
chosen. Injgeneral, do/you -think, the actiyity* sheets 




youjaave done have been reaated to plans on a Program 



U1 



• , ^Descriptor?/ That is, do. they f it -^ith *;^e gleois.* and r\ 
otrJeCtives worked" Q|it earSD^er ^ith your ^Lelf^ning Qoor-.f 
'dinator? (ProbB^f^r spedific examples.) : » ; 




^pedifi 




9k* 



7. 



.;*; .-, . Another l'orm-you,.QC3nEleted' during oi^ientVtion^waa/iheSv'^, n;\t V»>V ' ' 'i- 





(if student would request ^he site, 'probe to- find , out , 
what he/she thinks would happen to the request^ .what. 
' woixld EBCE do about it?)' , - • ^ 





Tit^e: -Learning Activities Interview- (Students) 



* Format : I n t er vl ew 



/ Subjects and Sampling:*" Students ' (random, n=lJ? - 15; 5 to receive both 
/• ' 18 and 19) 



Adrjinistration Schedule: 3/7I* ' ^ * ' ^ 

Reilability Compare responses on items common to instruments l8 and 



19 for students receivfhg both. 



' ",Walidity: No studies needed. 

t-r* 1 ' ' ' 



M 
m. ■ 



flir^ey To Questions In Part IV Of Plan: B-l^^d; D2-l-a, b, d, e, f. 



• * - ' Formative Evaluation 

. .12/12/73-Hilderbrand, 
W'ardrop , 

'^9 - Learning Activities Interview, (students ) 

Introduction : .We are trying to find out if there are any EBCE forms • 
or procedures that can be improved. In_the next few 
minutes I am going „to ask you' about several parts of 
. the program to find out if you have had problems with 

them or ha^ any suggestions for improving the way 

\ 

things are done. « • 

1. To begin v{ith, b'ack during orientation you were asked to fill out . * 
an Employer selection formV Did you have enough information about 
available sites and experiences to make what you think are "good" 
choi^ces? (if "No", ask: -HoW do you think we could improve the 
way the site selection is donfe?) 



r 

\ 



2. When you weint to find out something about an employer site, do 
you find the' Learnijpg Guides helpful? 



Is there anything that is not now included in\ Learning Guide s that 



you voiCLd like to know abou^t^the sites? 



r 

Do yqu find the wa;^ the information is presented in Learning Guides 
makes it easy for you to find what you want to know? * ^ 



l: 



3. Have you ever been .unable to do certain learning activities' you 
were interested in because the resources .(employer site, people, 
materials or books) were not available in EBCEf (if "*Yes", ask 
stu^ient to describe the situation and tell' how it was handled.) 



^^• Have you ever had difficulty completing an assigned activity 

/ ' ^ 

^ " because the materials you needed wer^ missing or otherwise not. 

available? (If "Yes'I^asH student describe the situation and 
tell how^the- prob(iem was handled/) . ^ 



b 



5»a. When your Learning Coo/diriator gives you an> -afcttyity sheet, to do, 
do you (Always^ ^suall/, SODietimes, 6r Almost Never) understand ' 
the purpo'se of the a/tivity?, (A U S N) 
Comments: 



ERIC 



Is what you are supposed to do (Always, Usually, Some times^^- Almost 
Never) c^Iear to you? (A U f) N) ^ 
Comments : . . ^ " 



c. Do you (Always, IJsuaily, Sometimes, Almost Never)'' know what 
"prpduct" you' are supposed to produce in completing an activity? 
(A U S N) Comments: 



d. When you start a new activity sheet, do you (Always, Usually, 
Sometimes, Almost .N^ever) know what basis the Learning Coordinator 
is going to use to evaluate your performance? (A U S N) 
Comments : ■ , . y • 



e. Do you (Always, IJsually, Sometimes, Almost Never) know how good 
job you have to do to re^e^-ve a good evaluation? (A IT S N) 
'Comments: ' ^ 



-\ ■ 



f. Do you think the standards used to^ Judge yonr work are (Always, 



Usually, Someti'mes; Almost jj^ever) fair? (A U S N) 
Comments: ' * ' 



A couple of more questions and ve wild* be* finished. \\ 

6* Do you think the things .you're interested in are feiven enough 
attention^in deciding^what activities you are going to do? 



7. Finally, do you have any other suggestions for how we might impr 
the operation of EBCE? 



\ ~ ' n 



■ . ? 



* . fe'ORMATIVE EVALUATION INSTRUMENT PACKAGfe 
INSTRUMENT NO. : 20 

Title: Student Perceptions of Employer Sites 
Format: Ratings 

Subjects and Sampling: Students. ^ 

Administration Schedule: ,* 

Reliability: * 

Validity: 

Key To Questions In Part, IV Plan:^ D3-l-f. 




?20' - Student PerceTPtions of T^pl<^Ver "sites ^ • ; ifrdroJ^'^^Pfl* V,:^," 



Level of Experien^ge/^ • 



Studept - ' W , , Observation ^ 

Employer ^ , [ ' ' Exploration 

No, of days at employer site ^_ ' ^ In-depth 



1, Was this one of the employer sites you .had selected on the employer selection 
form (this was filled out during orientation)? > ' * 



yes DO 



Estimate the percentage of time the employer resourcg/ person spent with you 
while* you were at the site, • « 

' : 26%-50% 51%-75% 76%-100% 



3, -My overall impression of the person- I worked with*mostJy at Uio abov(^ emt)lOyor 
•b-ito is: (check the *Tnst 'appropriafe space) 

J »_1._J _J '_J^ I. 



r i.iked'Very • .Liked ^ No Feeling' Disliked Di y'lTkeci^'vcrY 

Much ' Son)e * , - Some Much 

• ' / ' - , 

4, I would describe the employer resource person as (place one check in the 

appropriate box): * ' , 

1 • \ [ U i " 1 I 

Very Helpful^ Much Helpful Helpful Little Helpful Not Help^ful 

L — ^ — \ — I — t — ^ \ i: ^ I ! I 

Always • Frequently , Available Seldom , Never 

Available. Available ' ^ 'Available 'Available 



Very Warm \ * Warm ? ^ cold * Vety Cold 

^-il-l ' -I ' ^ , 1 . . I I -I 

Very Interested^ Much Interested Interested Slightly Interested Not Ipter^sted 

in me . in me . in me in rrte- , ' in me ' 

, » * ; ^ 

1 I -I ' i - I I 

Very Excited Somewhat Excited ? Somewhat * Did Not Like * 

About His Work About His Work \ ^ ' , Uninter-ested His Work 

^ in His Work • ' 

i - ' 

tone) 



5. While at *<?he employer, site Pwas treated mostly like Ochoose 



(a) a student (b) an employee (c) fi'^'quost 



I found that while I was at the employer site, I 



(a) observed mostly 
^(b) participated a ^eat deal 

{ c) loaf ed' mos tly 

(d) studied mostly 
_(e) ^.observed and participated about equally 



^eat deal 



If you were asked to grade -the employer site, what letter grade would you 
assi'gn? (Circle the .appropriate response)- " ' , - 



A =^ excellent 

B = abc5ve average > ^ 

C = average 



Q -'-poor 
*F = very poo^ 



If you were asked to grade the employer resource .person, what letter grade 
woulti you assign (check the appropriate response) 



A - excellent 

B = above average 

Cv.= average 



I) - poor 
^ T - very poor 



Comments : 



* FORMATIVE EVALUATION, INSTRUMENT PACKAGE 



INSTRUMENT NO. : 21 ' . ' ^ % 

Titles Criterion Reference Test Employer Site Analysis' 
Format: Objective Test (Crl^rionrRefer^ced) * • 

.Subjects and Sampling: Site Analysis Team (All) * 



Administration ''Schedule ; When' Analysis *Team -training is complotocK 

^: 

\ ■ . . 

Keliability: • Bepuise .pf :iniall number Of i^oapundorU s , sludif-. ik 

A " 

Validity: Content validation by tr;^ining;ii staff . 



Key To Questions in Part IV of. Plan: B-l-a, b. 



Hyre, Pfiffner 



#21 - Criterion^ Reference Test 'V ESnployer Site Analysis 



^ The following questions have been developed by us in order-^^ 
evaluate how well we achievedFOi;r g6als for . employer analysis 
training. The. evaluation instrument i^*a first attempt and We* 
recognize that -it's not -perfect. When you ar^sWer th^ questions, 
please don't feel that you are- going to be "^graded" on how well you do. 
^ust answer them \s be&t you can. Also, when you have finished .we 
would appreciate any comments- or sugges.tioris on how you feel this, 
evaluation could be improved.. ^ • r ' 

/Thimk you for your cooperation. r ' ' , - 

/ • . , ' ' 



' Employer Site Analysis Evaluation 
Pax;t I 



On the attached sheet is a list of procedures to' be followed when- 
undertaking Employer Site Anaiysis, Phase I refers to activities and 
prep^aration undertaken prior to the actual analysis interview; Phase II 
refers to those activities which take place during gmploy^r site vf": ; 
analysis « Please place each procedure under the proper phase, and 
then number each term dn the order in which it should take place 
Somew procedures may take place' more than once. 



ORDER * 



Phase I 
PROCEDURE 



ORDER 



'Phase II 

PRDOfDUlE 



Draftv 10-4-73t'C^v" 




Interview; Resource Perspns. 

. / ^ ^- V /' /' ' 

use WOW check list. . . , ; . * 



Vr'v' ^' interview con'tact perscxi. - * 



Fill out as much as possible of firstj.-'sev^ral pages of \Employ,^r . 
Site Learnilig Guides. ^ . o '/ * '1^ / • 

Mak^Conaaitprtent for "follow-up" (Wtu]hi>isit) , . ^ ' 



Consult central Wploy?^ ii^t^ files* 



h 



•••7/ '7 •■ <^ ' ' • • 7'/^ ■ /icX/i--- 



i^-;-7 ■ ■ 7 ' i\/ .S^7. • -:^7' 



^7 ' -^^r f ' -'./j^r ; '/ /7 / :'7:^</ ./';/7|/^ 



Y:b / . .7- / ' ^^y^^^^^^m^ 




X^ % i;,,^"^ ^V-'iCTps^'d Shop / '-'\v vv!:- y.V ^eKer:prov>sicn that ''they becormy^/a *y/Vjv: 

/ V-^'* . 'V" "-"^-^>V'V-- • ' .V ) / ' -^ Uiiiqn member wij;th<ln a specified/ . ^ , 




r^, J ^ , A labor ''pHDoy'/^pseii by a trade >or ^ . ; ^ 
; /^^'V/'-^^ ' : • i :* Y •> <3raft - union out- -of-^ which' specific ' 

' ' ' ^ ' ' >5d^k ass.i,gninerx?:s are made.- ' / ^ 



" : -/ / / / '-'i yj' V- ; ;> . ;. . ^ /. • Jto-ra na 

' z^'- -i'-'" • '>^'''^ :.^'"^y v;- '7- / •' 



. jA/jocai labor unionrwi-th -no, ties'- 
na'tipnal unioii^'.p^ganizatiori. , 



1. 



r 

•4- 



^'^•';£.;^Belw/^^ t^^k statements /''5j?ut an "O^cr' in ttont-o^^^^/[ 

'}/<^/T'Hata^ are acc^ptaiij^y ' I ^ bel^ve tt*r task.t 



,/ '. ' , ^Jt^ivin?: 'wjision^'CO/ ceacn people now to^^aoi anpioyer-sate analysis 
' ' ;' uMa' £orw6V'y3e^^ jiew materialsV Presentation or session is / 

V / ^ '/^<ii«.c/etionar,^ *)5W^ vety acqiirate-l . - L •/ * 



2. ,^Eicplaina-lioWj.tpVwrite task statements to payi;icipants 



3. Schedules/ r^oniB for'iiiS'arvice tr£Lining for employer site analysl^. 
^ 08e« secretiury verbal instructions. Obtainijig of a room 

highly prescribed - outcome must be accurate (ije. , has to aecure 
a, room) ' ' i ' / 



■ .- / 4 . •. 4.- ' Hands out materials for emalysis. -" 

f/y..ff • >r./- • ■ ' / • ■ * » ' , ..■ 

f' •>> 5j'',iKAi)8wer8 questions p^u^ticip^mts ask about employer site analysis. 



S r * ' » 



f 9 



\v*f^^In a few shoix Mexit^iili^B t brie^iV sum up wha^ you feel are the" 
piijEjiises of en^lo^r site'v^^nalyslfi your answer need not be detailed • 



J 



draft: 10-4-73 



, FORMATIVE EVALUATION INSTRlBlENT PACKAGE 
INS.TRUMENT NO, : 23 ' ^ • • • 



* 1, ^Pitle:' Case Study of Bnployer Sites 
^ " ^ -vPcft-mat : Questionnaire & Student's Career Exploration Guides. 



Subjects and Sampling: All on employer sites that have at least 5 
> • Career Exploration Guides filled out and 5 

^ student ratingfe. 



•Administration Schedule: hdarch, 197^ 
• FfeiiabiZityf . No studi.^s needed. 
Validity;;' / Ro studips intJpded. 



V "..Key To Questions In P.aVt IV Of Plan: Ji^S-,. If- 



* 'STUDENT EVALUATION FORM 

This form was develope'd because of the difficulty encountered in accurately assessing a student's perfor* 
mance using the 'traditional grading sy.stem. Therefor%, we are asking you to fill out this fonn after the stu- 
dent finishes his/her assignments at your employer site. Please fold and mail your evaluation back to the 
Learning Coordinator as soon as possible. Thrank you foryour assistance and CQQperation. / * 



Student 



Brief Description of Experiences: 



.Employer Site, 



Comments: 



' Personal Qualities 

Accepts and understands the needs, feelings 
and faults of others * ^. 

Accepts and fulfills responsibilities..., 

Exercises good lud^ment 

Displays leadership ability 

Has a sense of humor 

Is accepted well by other employees 

Is cheerful ^'.....^^ 

^ Is cooperative... » , 

Is courteous « 

Is creative 

Is dependab^ 

Is friendly ^. , 

Is honest and sincere;^.. 

I s I n d^tri ou s \ 

Is willing 10 accept suggestions 

^ Dresses acceptxibly 

Work and Performance 

' Consc^ientious in fulfilling assignments 

Docs worktieatly >... 

D.ocs work accurately 

Follows tiirections 

Does work independently 

•Works well in groups ^ 

Turns work in on time,... ^ 

Comes prepared, 

Listens and cooperates , 

Asks appropriate questions , 

Reports to site on time. 

Keeps scheduled appointments , 



Excellent 


Above 
Average 


Average 


^^low 
Aw^pe 


Poor 


Not 
Applicable 












- 


















































* 
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♦» 
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Attendance Sheet 



InStrtJCtions: For each day of the week that has been checked, please indicate student attendance with the 
following code • P/cscnr. E - Excused Absence; U * Unexcused Absence; H - Holiday. 

Student: '. 



.'Learning Coordinator: 



344-8371, Extension 





Monday 


Tuesday ~ 


Wednesday 


Thursday 


Friday 


Wcckof 












Week of 
Week of 




< 


— --\ 














Week of 













ERJC 



SlsMture of Resource Person: 



Preliminary 



Appendix C 
Problem-Solving Procedures. 



MEMORANDUM 




TO: Dr, Henderson, Hal Nichols, Bill Anderson, Curt J^iles, John Hilderbrand 

FROM: Karen Pfiffner 

SUBJECT:' ThlcHest Memo ever sent? 

DATE; September 21, 1973 



Atta^ed are proposed forms to be used to assist in problem solving for 
pTO«ap stabilization. There is a definite, but not necessarily evident, 
ordex%^^Fir>st, there "is the "Problem Solving Procedures" portion - ^^ritten 
by ^Cui?€ 'Miles last week to explain the various forms (attached) developed 
by Steve Hyre and Gary Shank. These forms should be reviewed by all of you 
to determine their viability. - ^ ' 

Second, I took orte specific form - the "Problem/Need Request Form" - and 
wrote cm explanation of it, irtimemo form, which can be sent to all staff 
if the -form is adopted, and, with a few ch|nges ccm also 6e inserted into the 
Operation Guides. I did not write memos bf explanation for the other forms 
because they seem fai,rly self -explanatory, because they do not involve "all 
staff", because they have not been o]^icially ayiopted for use, and because 
I got tired of writing. * • * , 

I suspect v^at is needed, at this point, is a meeting o-f all parties involved 
to make decisions 'regarding the feasibility.- desirability - revision - 
adbption of the included forms and proposed explcmations. This should be 
held as early^jas possibler next week because many members of field staff, I 
believe, feel a definite need for "FroblemAleed Request , Form" as soon as 
possible. As for me, I'm not even sure how I got* involved in this. whole 
issue cuid would like to use the form to find out. 



KJP/clh A 
f 

CC: Steve .Hyre 
Gary ^hemk 
Jack •Magan 



PROBLEM-SOLVING PROCEDURES 



/ 



/Outline of Steps & Methods 



Background 



Last year the EBCE project was working under the general strategy of solving 
problems is they emerged, of giving priority to immediate needs, and .of doing 
as much as we could within the time available. This year our requirements 
are clearer, our tim^jlines >re tighter, anS our needs and, priorities are 
sbmewhat different. Our. overall commitment^is to "Stabilization", which 
requires that we opcraLi^>nally define the conditions to achieve it, and be abl 
prove what'we have achieved.. Doing ^these things requires mor.e emphasis and, 
attention to evaluation, information systems, coordinating .our decision- 
making, documenting our decisions and activities, and other activities which * 
fall wi-thin the general sphere of the Stabilization Unit. A majox concern 
within this general mandate' is a clearer, more systematic, and more effective 
method of identifying and solving problems,' Thfe procedures outlined below - 
are a response to that need; they reflect the initial thinking and^work of 
Gary shank, Steve Hyre, Curt Miles, and Karen Pfiffner, as reviewed and 
revised by a number of other staff menibers. 

" tPurpQSes , ' ' , 

4 . * . ^ ' '^^ 

^TJiese procedures are designed to be used flexibly, for big and little concerns 
f in-order to: * ' >^ ' 

^ I ' \ . ° 

(1) Allow each of us to get project problems ,• neBds , and concerns 
'-^^ ' down' on paiper; ' / ■ - ' 

(2) Build a firm database 'corjcernin^ project problems and solutions; 
\ \- ' ^ f 

(3) 'Give all of us (as individuals, task forces, and units) a way 
i^. ■ ' of rcd-flagginq concerns; 

\' (4) ^ Allow us to deal with problems from the point of view of the 

I total project, not just of individuals and units; and 

(5) - Insure that problems are solved, not lost between the cracks 

of divided responsibility and time pressures. r ^ 



1 



Summary of Problem-Solving Steps * \ 

The overall, problem-solving procedure contains seven major steps , as follow: 

^ Step^l - raentification . A unit, task force, or individual .identifies 

a problem, need, or concern. 

« * ' * 

Step. 2 - Repo rting ^. Thej person or group who 'identifies the problem 

clarify its. precise nature, and report it *on a special form. This 
*- •^^*form is sent to the Unit Head and to the St^ilization Unit. 



7/ 



Step - Review . The Unit head reviews the problem, and gets more 
.clarification of it if he feel^ this is necessary. He decides 




the matter is interVial (i,o. 

doesn^t involve the other units), 
ling whichlp>'es' involve the. other units) . 
Simultaneously, the Stabilizfation Unit collects and assesses 
^ , wltj^tever informati(i)n it has ^out the problem,,'^ and makes a 
similar internal/external decision* 

- • ^ \: M 

^^^P ^ Assessment/Initial Deci:^ ^h^ Every problem which is reproted 
i . ^ reviewed b7theStabgM& Management Teaiii (Erdject Director 
'and the three Associate' &3|qit Directors) . The SMT reviews the 



a* 4 



internal/external recoirSnBjx'd^ 
Stabilization Unit head 
^^jpintly decides on ^he a(:^;t;ifl^ 



^. hs of the Unit head and the 
' 'recommendations may differ) , and 
> mi-^iE'^- '^he review and decision 

may be very=^refimctory v^h^ptBe^ action is' obvious (e.g. 

toss It bacid to the'unitf|^^^ io handle) ; it may take in-depth 



, ■ investigation (when the p|fcWet]^ma^ require a special task force, 
^ or major decisions) . The ISM? makes a decision, documents the 
decision and reasons^ for it, ' artd informs the pertinent parties 
ftWose who will carry out the decision, and the initiator of the 
■ problem) 

Step\5. - Recommenda:tions . If the problem, is tossed back to the Unit 
ffead, hfe takes action and simply dpcuments what it w^s and why- 
^'If, however/ the problem i^ given to a task, forcer^'^a unit, or the 
like,, .then Steps S-*^' take place., tftioever' deals -with the problem 



It 



mus'^fc Analyse, its naturjj 

then, prepares a set of l^commendationsVeubmits -Its recommendations, 
problem analysis, and reasons for the specific recommendations, 
."^tt) t*e SMT. ; ' • 



^J^ii"Plica't;^ons, .and possible solutions, 
f recommendations^ submits -i^s rPrnmtn<anH^ 



^ 5tep-'6^-^ Final Decision . The SMT reviews the recommendations and 

analyses of the ta-Sk^ force.. They 'm^e a decision * about .the, action 
, to be taken, and then document.j^theiji decision (implement the 

; ^ ' ' recojnmendation, 'send it back for tutfthe]- work, or do something else) . 

Step 7v-" ^pesolution . A task force, a. uhilt, c/an individual then 

;^ carries out the approved rscommepdktiion.. The result of -this action 

. is^^thenCcare fully evaluated, for , white v^r^ period of time is necessary 

. ^,^^/\to and.out If the initial problfem^^as fcieen effectively resolved 

^ ' ' . * ^ ' V- T '^-^ / 

- Using the Problem-Sblving Steps i ' \ '/ ' ' ^ ^ • ' 



These -seven steps- appe^massivevand lengthy.'- TheV need>i4t. be. They are 
intende-d^o allow us to re^olvc^ problems efficiently, to document our actions, 
and, to make u^e of all_ available informat^oj^i and ihsights^iii our decisions . 
The steps are, not intended to oat up time, "cause; dfelays in 'giiickly-needed 
decisions,. /Sr^give people a way of venting minorUbmplaintl.and gripesT To 
avoid-, such, dangers the steps -are intehded to\be uqM flexibly and with 
■consy39ra^5ld_ common' sense. ^. !! ■•'. 



For example J 



A Unit head who gets a problem form which requires irranediate 
action will go. ahead ar\d act/ He'll then docxoment what he did, r^i 
and let 'the SkV review it so everyone will know what's been done, 
afid why. 

* * 
Routine problems (e.g. ^ere^the hell did the station wagon go? 
I need it.') don't: go into the system. If it's anythitig which 
you suspect might hint at a flaw in the way the program works, 
then report it.* • 



The seven-step process doesn't have to be time consuming. It'? , , 
quite possible that it can be completed quickly, and or with 
little trouble. For example, a need for an additional piece of « 
information on the, program descriptor iftight require little total 
effort - quick and obvious decisions through Step 4, a couple of 
people working for an hour on Step 5, and the same people making ^ 
,the<^'change in another hour at Step 7. Or, the SMT can be convened 
at a moment's notice if something comes up which demajids which"/^ 
demands quick action and involves several Units. 

.The problem doesn't have to be immediate. If you think of sp% 
thing that you aren't sure we've anticipated, and will run " 
next month, report it. You'll get word back if it's alrea 
taken care of^ and yqu may have done us all a great favor 
hasn't. 



The problem doesn't have to be' a problem. 

of the' "Say, why don't we " variety. 

by reporting it. ^ . 



You may have an i 
Put it into the sy 



Mechanics and All That 



Forms 




There are a number of them, but the key one is the "Probleg/ 
Need Request Form ",- which |s the one that starts the process;/^ 
tt requires the initiator /to analyze ar.d think a little bit,.;35\ 



3?ut 



that's good for the soul. \a11 * the forms are enclosed, viith,fa|V3 
description of who uses them^ how, and when. 



Responsibility . The Stabilization Unit has responsibility* for as'^uri'ng 
that the system works, and keeps working. 

Distribution of Forms , 'Each ^rson will have a bunch of 'the Vro. 
Need Request Forms. A secretary in each Unit Vill have cop 
of the others. ' 




ERIC 



DRAFT 



PROBLEM/NEED REQUEST, FORM 



Fron 



To:'' ( ' ') Director . Date; 

'( )bes, U. 

( )pps.- U. " 

( ")Stab. U. 



What' is the Problem? 



What ^re the causes? 



Examples (as appropriate).: 



Recommended Solution: 



UNIT HEAD RECOMMENDATION 



SMT ^^COMMENDATION 



I Da tie: 



Date: 



internal 



external 



internal 



e^xtemal 



unsure 



oth^r 



DRAFT 



. / 



Date: 



Request Person: 



SMT DECISION 



,Re4. Form # 



Reasons/Degcription For StfT Action ; 



I' 



-/ 



J 



ERIC 



• a R A F T . : a * ^ t f ^ 



^^^^^ 



•Kequept Forrn -^^j^^^Jj^ 



TASK pbRcfe WORK SHEET 



I, 

9. *• ^ 



Specific Problem- ; • ' . ^' : " ' ^ ^ . ' 



• Analysis of ^eeds/Identification o£ Alternative^ 



Analysis of Alternatives ; ' ^ ¥ 



• / 



/ 



h 



4 



t 

Q 



1. ^ 



VS./-. 



IBlc . . ■ . f . .. y- ' ■ 



DRAFT 



Date: 



TASK PORCE/SMT REPORT SUMMARY 

« 

Req. # _ 



Specif ication of Problem; 



Data Involved: 



Implications: 




Recommendations/Reasons : 



ERiC 



Date: 



SMT DECISI 
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approvt recotamendation 

reqpnsider 

other : 



MEMORANDUM 



TO: 

FROM:' ' 

SUBJECT: 

DATE^ 



All Staff 
Karen Pfiffnei: 
^New Form 
10-8-73 



Attached is a^draft of the "Problem/Need Request Form" which has been . 
developed to assist in program stabiliz^tj-on. Its purpose is simple: ^ 

1) to identify project pr-oblems which impact on smooth, program .Qper^t^Qn;\:: ; ■ • ' 

2) to prbvide you with specific channels of communication .ror p^dblem ^r'' - 
solving and decision making; <3) to prpvjd%.ybu-:>ifcU -organ^ze^'^nd documented 
feedback on what is being dpr^e,abp^t;'^a'^r«bie1i<5^OTd:>) to allow us to 
document procedural -%a>g4s;^?S^^^ for-pro^ram stabilization/ 

^: replicatjoi^^^v ^ • . \ , 

The Wm is fairly self-explanatory, however , . the^rej are a' /few things 
v^;you need ti/kxibw. Each form will have a unique nximber ^to provide a way to 
'^track all o% the forms and data relating to that specif-ic problem. The form 
^'v^vfill be in duplicate. When you use it, one copy will go to the head pf 

\y^ur unit and the other to stabilization which will I assign to it ;the unique 
- nVmber. Your unit head then reviews the problem, and gets more clarification 
of it, if n^dessary. He decides whether or not, irl. his ppijiion-, the mattel: 

internal Yi.e. ," something he must deal with, tnat doesn't involve ^the ^ 
other units) \ or external (something vihich does irivoXye'the other units) . . 
Simultaneously, the Stabilization UnitJ collects and assesses whatever infor- 
mation it has .about the prolDlein', and m'akes a simlikc'intexnal/extemal 

* decision* » • \ . * ♦ , ' . ' • 

At this poiht-i several optipjis are available: your unit head may work 
out. the problem by himselfi or within hi's unit: it may be worked out jointly . 
among the unit^* h/ads and Dr. Heij^erson: (This is referred to as the SMT - 
Stabilization-Malnagement Team - >nd consiats of Dr. Henderson, Hal Nich9ls, 
Bill Anderson, /and head of 'stabilization) ; or, -a task' force may be assigned' 
to work out th4 problem. .In any case, when a scilutioa has been identified 
' you will be Notified of it in written form and it will then become part; of 
operational Procedures. Although these procedures will take a little time 
please do i/ake use o'f them .because the . end result will be good - everyone 

• will end-up knowing what,has been done" about a problem" and why 5 

• i/' ■ :-: : ;/ 

There' are several cautions to be considered when using this sheet. : :j 
one, try to use common, sense when deciding to report a problem, flinor-day 
to day foul ups should, not go into the system unless you 'feel that they ..are 
a flaw in the way the program works. Two, the problem doesn't have to be 
immediate. If you think of something that you aren't sure we've anticipated, 
and will run into next month", report it. You'll get word back if it's.^lready 
been taken care of, and you may have donfe us all a great favor if it hasn t. 



* r-THreer /tfie problem dofetsYi' t have to be a problem. You may have an idea ^ 
of ^'thes Asay ^ w^y- don't, w^'.'-' .V^V;> variety. Put it[liiit^b the system by reportd^g,,^ 
"it: Arid four'/ aithoiigh >thei form asks, .fd'r causes'' 4nd recommended solutions", 
you heed nat ,feel dblj^ated ;t9;rf:den'ti£yreitherj There is nothing wrong with 
seeing ',a problem, but' n6t i^dei^^^ its cacS^- iir how to 'solve it. That*s 

what the whol^ pratediirp; is vfor. Anyway .1 J . ' . . . ^- ^ . 

If you /^aye- any- questions ' or cxiricern.s about this form aSi'dprpper ^---^ — 
procedures feel fre^' .to ask.^-^(J^r^ iise4\he new form!)/ V ' 



••V 



■ i 

« 



: • ■ ' . •/ 
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